← sources

A randomized trial found experienced devs were 19% slower with AI tools, while believing they were faster. Have you timed yourself?

source: reddit (reddit:developersIndia)published 2026-10-12 10:12ingested 2026-10-13 02:37

retained text

In July 2025 the nonprofit METR published a randomized trial: 16 experienced open-source developers did 246 real tasks on repositories they already worked on, with AI tools randomly allowed or not (mostly Cursor Pro with Claude 3.5 and 3.7 Sonnet). Tasks took about 19% longer with AI. Beforehand the developers predicted a 24% speedup, and afterwards they still estimated about 20% faster.

METR itself says the sample is small, the tools were early-2025 versions, and the result doesn't mean AI never helps.

Have you ever measured your own time on similar tasks with and without AI? What did you find?

document fetched 2026-10-13 00:25 · canonical https://reddit.com/r/developersIndia/comments/1x3y26i/a_randomized_trial_found_experienced_devs_were_19