← sources

Evals in the new world of software development

source: reddit (reddit:AI_Agents)published 2026-10-19 10:22ingested 2026-10-20 02:35

retained text

Its becoming increasingly clear to me that the world will see the next step improvements in harness design and efficiency through evals. Its critical that you constantly do it on what you build and create a recursion loop to pick further improvements. The more this is automated the faster you are going to move.  

For ex. recently Claude code team published info around how they are trying to make their review process faster by running an eval for every real world run were something might have gone wrong and then suggest what needs to change to make the whole system better.  

It's like how in the past automated test were important for shipping a quality and stable product for users with the right speed. In this new world its replaced by these evaluation systems. Here is where I am going to be spending most amount of time this quarter.   Even more promising since I see almost all big players investing here - like the google's harness2.

document fetched 2026-10-20 00:19 · canonical https://reddit.com/r/AI_Agents/comments/1x9t5bd/evals_in_the_new_world_of_software_development