← sources

What does your agent use for web data, and what have you had to hack around?

source: reddit (reddit:AI_Agents)published 2026-10-27 03:49ingested 2026-10-28 02:35

retained text

Curious what people are actually running in production: Exa, Tavily, Firecrawl, Serper, context dev, your own scraper?  
What do you use?  
Are you happy with it, or did you switch at some point?  
What's one thing you had to build or patch around it (retries, filters, validation, caching)?

document fetched 2026-10-28 00:20 · canonical https://reddit.com/r/AI_Agents/comments/1xgicg1/what_does_your_agent_use_for_web_data_and_what