← sources

Why is it so fussed over web scraping now?

source: reddit (reddit:ClaudeCode)published 2026-10-10 14:49ingested 2026-10-11 02:41

retained text

Guys. Why is claude acting like a wanker lately. I just wanted it to download 20-30 reports from the internet to compare numbers and sometimes if he gets either a cloudflare check or reads some silly policy on robots.txt that bots are not allowed, he makes a drama about it. And says I won't try to bypass cloudflare.

It's not so long ago it happily did it. This is not even real scraping, though I have written actual web scrapers with it which bypass all sorts of shit. But not even grabbing 2 pages from the internet which are already public, is too much drama I think.

document fetched 2026-10-11 00:36 · canonical https://reddit.com/r/ClaudeCode/comments/1x2h4zj/why_is_it_so_fussed_over_web_scraping_now