← sources

Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights [R]

source: reddit (reddit:MachineLearning)published 2026-11-02 20:18ingested 2026-11-03 02:39

retained text

Link: https://rikiyat.github.io/blog/weight-space-programming/

Snippet: “We find that frontier LLMs are surprisingly good at **natively reading and writing neural network weights**, well past what we’d expect from humans or conventional algorithms. This might be a big deal for both optimization and interpretability.  
Just by looking at the raw weights, GPT-6 Astra **can tell what a network was trained to do**. And without any environment feedback, it **has no trouble writing, from scratch, small game-playing networks** that outplay networks trained with PPO for 100 million steps.”

Very surprising result, I didn’t expect frontier models to have this capability that has not been optimized for, and it’s something humans cannot do either. 

document fetched 2026-11-03 00:27 · canonical https://reddit.com/r/MachineLearning/comments/1xm89ef/sparks_of_weightspace_programming_llms_can