Qwen 3.8 27B on my laptop can interpret model weights, too
- ID
- 42581
- Status
- summarized
- Published
- 04 Nov 2026, 12:29 AM
- Fetched
- 05 Nov 2026, 3:10 AM
- Provider
- Simon Willison
- Category
- developer-ai
- Original URL
- https://simonwillison.net/2026/Nov/3/qwen-can-interpret-model-weights/
- Source URL
- https://simonwillison.net/atom/everything/
Summary
- Score
- 7.5
- Created
- 05 Nov 2026, 3:10 AM
- Tags
- Audience
- ai_ml_learnersdevelopers
What happened
Simon Willison reproduced an example from the paper "Sparks of Weight-Space Programming" (Rikiya Takehi, Jayden Teoh, Alex Zhang, Omar Khattab) using Qwen 3.8 27B running on his own laptop, showing a local model can inspect raw model weights — a text dump of floating point numbers — without tools. The paper's headline claims are about GPT-6 Astra: writing small game-playing networks from scratch that beat PPO-trained nets, and fixing Qwen3.5-0.8B's reasoning loops by editing 0.016% of weights, lifting MATH-500 from 7.9% to 48.1% and tripling IFEval. Willison deliberately splits the two questions, and notes Matthew Honnibal called the paper misleading for conflating no-tools weight reading with code-assisted model editing, while Sean Goedecke deconstructed the Qwen3.5-0.8B example as steps a human ML researcher would take.
Why it matters
Before you repeat the 7.9% → 48.1% MATH-500 number as evidence that LLMs can 'edit weights', check which claim it belongs to: the paper bundles no-tool weight interpretation with code-assisted model surgery, and two named critiques dispute the second. The practical takeaway is narrower and testable — a 27B model on a laptop can attempt the no-tools reading task, so you can run the paper's grid-game examples yourself rather than trusting the abstract.
Discussion angle
Where exactly is the line between 'the model read the weights' and 'the model wrote code that a researcher would have written' — and does the laptop-reproducible 27B demo survive that distinction?