← sources

The “Karpathy” CLAUDE.md clearly changed Claude Code’s behavior on 2 of 4 tasks

source: reddit (reddit:ClaudeCode)published 2026-11-03 03:11ingested 2026-11-04 02:41

retained text

The [CLAUDE.md](http://CLAUDE.md) file with \~228k stars (forrestchang/andrej-karpathy-skills) isn’t written by Karpathy himself, it’s based on his observations. It has four rules: think before coding, simplicity first, surgical changes, and goal-driven execution.

Same 4 tasks with and without it, 3 runs each, so 24 runs. Claude Code 2.1.312, Opus 5.5, a small Node.js project, fresh copy every run.

Vague request (“make the user export handle dates properly”, with 03/05/2024 in the data): without the file, all 3 runs wrote code (25 to 31 lines) and then said what they’d assumed. With it, 2 of 3 stopped to ask first. All 6 noticed the date problem, so the file changed when you get to decide, not whether Claude spotted it. The third run with the file made an 8-line change that let unknown date text through unchanged, which the runs without the file rejected. Shorter wasn’t better there.

Messy file with a discount bug: all 6 runs fixed the same single line and left the dead code alone, so Claude was already surgical without any rules. But all 3 runs with the file added a regression test, and none without it did.

Retry helper: 10 to 12 lines with the file vs 12 to 17 without. Small enough that more runs could change it.

Clear bug: no difference. All 6 made the same fix and added a test.

Hidden tests Claude never saw passed either way, so correctness was the same with or without it.

Totals across 12 runs each: 274 sec vs 281 sec, $2.56 vs $2.69 by Claude Code’s estimate. That doesn’t count the back-and-forth after you answer its questions on vague prompts.

Limits: 3 runs per setup, tiny projects, one model. The repo’s last commit was April 2026, so it wasn’t written with Opus 5.5 in mind.

If you already have a [CLAUDE.md](http://CLAUDE.md), don’t use the `curl -o` install, it replaces your file. Append it instead.

[https://aiparabellum.com/karpathy-claude-md-guidelines-tested/](https://aiparabellum.com/karpathy-claude-md-guidelines-tested/)

document fetched 2026-11-04 00:40 · canonical https://reddit.com/r/ClaudeCode/comments/1xmhy1d/the_karpathy_claudemd_clearly_changed_claude