# Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights [R] — retained record

> Retained reddit record from reddit:MachineLearning.

Canonical: https://highsignal.app/data/records/3022d5db44f41558

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:MachineLearning)  published 2026-11-02 20:18 ingested 2026-11-03 02:39

[original source ↗](https://www.reddit.com/r/MachineLearning/comments/1xm89ef/sparks_of_weightspace_programming_llms_can/)

## retained text



```
Link: https://rikiyat.github.io/blog/weight-space-programming/

Snippet: “We find that frontier LLMs are surprisingly good at **natively reading and writing neural network weights**, well past what we’d expect from humans or conventional algorithms. This might be a big deal for both optimization and interpretability.  
Just by looking at the raw weights, GPT-6 Astra **can tell what a network was trained to do**. And without any environment feedback, it **has no trouble writing, from scratch, small game-playing networks** that outplay networks trained with PPO for 100 million steps.”

Very surprising result, I didn’t expect frontier models to have this capability that has not been optimized for, and it’s something humans cannot do either. 
```



document fetched 2026-11-03 00:27 · canonical https://reddit.com/r/MachineLearning/comments/1xm89ef/sparks_of_weightspace_programming_llms_can
