Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights [R]
retained text
Link: https://rikiyat.github.io/blog/weight-space-programming/ Snippet: “We find that frontier LLMs are surprisingly good at **natively reading and writing neural network weights**, well past what we’d expect from humans or conventional algorithms. This might be a big deal for both optimization and interpretability. Just by looking at the raw weights, GPT-6 Astra **can tell what a network was trained to do**. And without any environment feedback, it **has no trouble writing, from scratch, small game-playing networks** that outplay networks trained with PPO for 100 million steps.” Very surprising result, I didn’t expect frontier models to have this capability that has not been optimized for, and it’s something humans cannot do either.
document fetched 2026-11-03 00:27 · canonical https://reddit.com/r/MachineLearning/comments/1xm89ef/sparks_of_weightspace_programming_llms_can