← sources

The best AI passes 37% of real engineering tasks. Most people would pass none

source: reddit (reddit:singularity)published 2026-10-28 00:01ingested 2026-10-28 02:37

retained text

Xplore released RWE-bench today, 20 mechanical, electrical and aerospace tasks written by engineers who do this for a living. One is a diesel crankshaft that has to survive 2,400 rpm, one is routing a DDR3 memory bus on a real FPGA board, and one is CFD on a turbine vane. No model grades the results. A program checks every design against every requirement and runs physics solvers where it has to. GPT-6 Astra leads at 37%, Opus 5.5 is at about 29% and GPT-6.1 Sol at about 25%, for $10 a run. Astra and Opus cost about six times that per run for 12 and 4 more points.

37% sounds low until you ask how a person would do. Give someone off the street the same tasks and tools and they pass none, because they won’t get past drawing the part in CAD and running the simulation. An engineering graduate might get one or two in their own field after a month of work. A specialist would pass the ones in their own field, about a third, at roughly a week each. The model does some of all three fields in a few hours a run. The human time and what they could do are my own rough estimate, Xplore doesn’t publish a human score. (but i think they should next time!)

Code got good fast because you can check the answer, and most physical engineering has a much longer feedback loop than code. There’s still a lot of work to do, but now it’s work with a scoreboard, and from what I’ve seen that’s what makes the next jump happen. I wrote up the tasks, the human comparison and why I think the grading matters more than who’s on top: [https://www.anchorterminal.com/blog/rwe-bench-engineering](https://www.anchorterminal.com/blog/rwe-bench-engineering)

document fetched 2026-10-28 00:30 · canonical https://reddit.com/r/singularity/comments/1xh93pq/the_best_ai_passes_37_of_real_engineering_tasks