← sources

For people shipping agents to clients - what breaks weeks after the demo?

source: reddit (reddit:AI_Agents)published 2026-10-30 12:33ingested 2026-10-31 02:35

retained text

The demo works, the client signs off, everyone is happy. Then a month later comes the message: this worked before. I am especially curious about agents that lean on RAG or a knowledge base or any external data that quietly changes underneath them. When it drifts, what is actually hardest to diagnose - the corpus changed, the chunking, a silent schema change upstream, a prompt that was always fragile? And what do you put in place at handoff so you are not debugging blind later? Looking for war stories, not theory.

document fetched 2026-10-31 00:19 · canonical https://reddit.com/r/AI_Agents/comments/1xje4xj/for_people_shipping_agents_to_clients_what_breaks