← sources

The Bottleneck is Context Window

source: reddit (reddit:ClaudeAI)published 2026-09-30 16:13ingested 2026-10-01 02:38

retained text

Anthropic/OpenAI are competing with each-other, pushing out smarter and smarter models.    
I think the models have been smart enough for a long time now.   
The issue is the context window.    
Sure if you have an easily and narrowly definable problem like coding it's easy enough to create a reference/memory whatever system and have fresh agents getting spun up and routing them to the correct context/source material is easy. Coding lives in well defined spaces like source code files, versioned in git, documentation etc.    
If you are trying to replicate a workflow from a huge company where each employee has a very narrow responsibility with tightly measured and controlled workflow it is easy to replicate their work.    
I have experience with the above two. But I also have experience with how anything smaller like in manufacturing is done and none of the AI's can keep up. You either teach it to extensively search your KB before any action and you wait minutes for every small answer or you let it decide when a search is needed and it will pile mistake upon mistake. In real life every action has a million inputs that will not only change in values by the next time but also by what input needs to be considered.    
    
If we are to accelerate these companies need to change focus. We need a model that can build and execute on a huge context window; that could replace so many seat-warmers it's not even funny.  
 

document fetched 2026-10-01 00:24 · canonical https://reddit.com/r/ClaudeAI/comments/1wu942h/the_bottleneck_is_context_window