← sources

Any info that Claude team plans on improving the web search?

source: reddit (reddit:ClaudeAI)published 2026-09-23 09:00ingested 2026-09-24 02:36

retained text

Compared to ChatGPT and Gemini, web search is restrictive while following the robots.txt instructions that it literally refuses and cannot access a lot of sites. 

At the same time, ChatGPT and Gemini don't have this issue.

I understand you can argue this is the correct decision, but how is ChatGPT able to do it without issue?

It's a eliminating feature for me and I believe for a lot of other people.

document fetched 2026-09-24 00:24 · canonical https://reddit.com/r/ClaudeAI/comments/1wo0oaf/any_info_that_claude_team_plans_on_improving_the