I don't understand why developers still talk about RAG
retained text
Can a code editor on the terminal not retrieve all information easily? Why do you ever need a RAG which has a complex Vector database and processes like chunking embedding etc. The retrieval is not smooth either, numerical vectors has to be converted back to original form and the data size would be much smaller than what the LLM is capable of handling. Remember that in the age of AI users would be better to learn using computer terminal Else it would be a very expensive affair for the company to maintain a dashboard. A terminal based code editor can search through large amount of data directly. I can understand it was needed before Terminal based code editors were available. But now the LLM token costs are less, context limits are high. Simply speaking if the end user learns to use the Computer terminal then he can retrieve any data stored in the system securely and efficiently. The technology is now much advanced and complete than what was two years back when RAG was conceptualised because of LLM hallucinations and high token costs, yet earlier RAG system was inefficient and expensive. Vector DB based RAG has an inherent flaw, The user query is directly fed to Vector databases bypassing the LLM even though The LLM is the most advanced technology to understand user context. The complexity induced because of mismatch of input data, embeddings in Vector DB and the raw data used for LLM is a big bottleneck in my view. You would need a developer each time the data is added or modified in case of Vector DB. Unless it is for large projects like Search Engines, RAG based on vector databases has no relevance in my understanding. Research says 70% of Enterprise RAG Deployments Fail Before Production: And please let me know if you are handling any new paid RAG projects. I am yet to see clients interested now in that after so much advancements in LLM, tools and the clients being more informed themselves and the value these RAG systems provide. Edit: Some of my obeservationa are with respect to older RAG systems. The newer systems are significantly better. However my core conclusion remains the same.
document fetched 2026-10-30 00:24 · canonical https://reddit.com/r/developersIndia/comments/1xio8vi/i_dont_understand_why_developers_still_talk_about