# Coding is solved* (exclusions apply) — retained record

> Retained reddit record from reddit:LocalLLaMA.

Canonical: https://highsignal.app/data/records/3454c237aaf130ee

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:LocalLLaMA)  published 2026-11-01 17:31 ingested 2026-11-02 02:41

[original source ↗](https://www.reddit.com/r/LocalLLaMA/comments/1xl90rr/coding_is_solved_exclusions_apply/)

## retained text



```
Good news, everyone! [Having been inspired to revolutionize the field of computer science](https://finance.yahoo.com/sectors/technology/articles/elon-musk-coding-top-job-163850758.html), I can now report that *coding is solved!* Sure, only if you care about x86 Linux binaries that print and exit, but "big journeys" and "small steps" and what not.

[CRAP (Compiler Replacement for Assembling Programs)](https://huggingface.co/matthewhaynesonline/gemma-4-E2B-it-crap-1.1) is a Gemma 4 E2B fine tune that takes prompts like `generate a Linux x86_64 binary that prints 'boop'` and emits a working ELF binary (as hex, most of the time, every time). See, since programs end up as a binary anyway, why not just skip the middleman and write the binary itself? No compiler, no assembler, no tool calls. [v1.1 is out with improved multi turn and out of distribution performance](https://huggingface.co/matthewhaynesonline/gemma-4-E2B-it-crap-1.1). Trust me, I know, this is super important work.  


https://preview.redd.it/gngsbvezc1zh1.png?width=1076&format=png&auto=webp&s=481f6ea0897d2f324272b59b6bf42c337daf3b2d

  
**v1.1 eval numbers for the nerds** (eval is scored on behavior: the binary has to run, print the right string and exit with the right code):

* Held out legacy set: 20/23, same as [v1](https://huggingface.co/collections/matthewhaynesonline/crap)
* Novel strings: 26/40 ([v1](https://huggingface.co/collections/matthewhaynesonline/crap): 8/40)
* Multi turn (\~3 turns): 10/12 ([v1](https://huggingface.co/collections/matthewhaynesonline/crap): 0/12)
* Doubled character strings (`boom`, etc.): 18/24 ([v1](https://huggingface.co/collections/matthewhaynesonline/crap): 2/24)
* Random jank exit codes it never trained on: 23/25

*An interesting tidbit: one training run hit 0.038 loss while still failing 11 of its 12* ***trained*** *exit codes, so gradient descent != task completion ascent.*

  
[**Aaannndddnd it runs in your browser.**](https://huggingface.co/spaces/matthewhaynesonline/crap-demo)   


https://preview.redd.it/xkz0lvr1d1zh1.png?width=760&format=png&auto=webp&s=5c5be9a9c3f4cee8663f20fea79097480a857438

  
The demo loads the Q6\_K GGUF (\~3.6 GiB) through [wllama](https://github.com/ngxson/wllama) on WebGPU, streams the hex, parses it and hands you the ELF to run yourself (naturally, you need to download and run the actual binary, the browser won't do that). Q6\_K scores 109/144 against the full f16's 114/144 (the five additional failed for Q6 are wrong values, not totally broken binaries). Q4\_K\_M scored 3/144, so the demo doesn't use it (that quant is crap, not CRAP) ... *concerning*. Also, tested in Chrome on an M4 Pro Mac; Firefox loads it but generates slowly and nothing else has been tested.

* Demo: [https://huggingface.co/spaces/matthewhaynesonline/crap-demo](https://huggingface.co/spaces/matthewhaynesonline/crap-demo)
* Weights (v1.1): [https://huggingface.co/matthewhaynesonline/gemma-4-E2B-it-crap-1.1](https://huggingface.co/matthewhaynesonline/gemma-4-E2B-it-crap-1.1)
* "Paper": [https://github.com/matthewhaynesonline/crap-public/blob/main/paper/paper.pdf](https://github.com/matthewhaynesonline/crap-public/blob/main/paper/paper.pdf)
* Code: [https://github.com/matthewhaynesonline/crap-public](https://github.com/matthewhaynesonline/crap-public)
* Blog post: [https://blog.studiohaynes.com/2026/07/19/compilers-overrated.html](https://blog.studiohaynes.com/2026/07/19/compilers-overrated.html)
* Video: [https://youtu.be/55IBMzFQNYU](https://youtu.be/55IBMzFQNYU)

*Fine print for the buzzkills: only programs that print a string and exit can be generated. Obviously, a compiler does that deterministically, correctly and in milliseconds; CRAP does it with several gigabytes of weights, slower and occasionally incorrectly.*
```



document fetched 2026-11-02 00:36 · canonical https://reddit.com/r/LocalLLaMA/comments/1xl90rr/coding_is_solved_exclusions_apply
