Sam Altman: “Local inference is a terrible allocation of scarce resources”
retained text
Sam Altman: “*Local inference is a terrible allocation of scarce resources.* *A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data centre* *but from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time* *you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment,* *somehow many people's intuition is the opposite of that”* *——————————————————————* **TL;DR Guy selling product: "Here's why owning your own product instead of renting it from me is a terrible idea"** (Credits to @RyanTStull, his TLDR made me laugh)
document fetched 2026-10-30 00:44 · canonical https://reddit.com/r/LocalLLaMA/comments/1xizbq1/sam_altman_local_inference_is_a_terrible