# Nonobench v1.2: 43 LLMs on nonogram puzzles. Open-weight DeepSeek V4 Pro ties for 4th, and no open model solves the new 20×20 Hard mode — retained record

> Retained reddit record from reddit:LocalLLaMA.

Canonical: https://highsignal.app/data/records/c813f244d1fda9ee

[← sources](https://highsignal.app/data)


source: [reddit](https://highsignal.app/data/reddit) (reddit:LocalLLaMA)  published 2026-09-27 10:51 ingested 2026-09-28 02:41

[original source ↗](https://www.reddit.com/r/LocalLLaMA/comments/1wrh7b2/nonobench_v12_43_llms_on_nonogram_puzzles/)

## retained text



```
Follow-up to my January post: https://www.reddit.com/r/LocalLLaMA/comments/1q4i19c/benchmarking_23_llms_on_nonogram_logic_puzzle/. That thread shaped v1.2:

- Reasoning effort is explicit per run
- Every prompt and output is public.
- All current top ranking private and open weight models have been added
- Someone spotted Grok miscounting a 400-character answer. Turns out that trips up most models, so Hard mode answers row by row rather than a single text string.

Results:
- GPT-6 Astra: 30/30, the first perfect run on 15x15 puzzles
- Best open weights: DeepSeek V4 Pro 83% (tied 4th), DeepSeek V4.1 Flash 77% for $0.84 total
- Hard mode (10 random 20×20s, one solution each): Opus 5.5 8/10. Every open-weight model: 0/10

Still OpenRouter-only, so no way to run locally yet. PRs welcome.

nonobench.com (raw data, API, and code on GitHub)
```



document fetched 2026-09-28 00:39 · canonical https://reddit.com/r/LocalLLaMA/comments/1wrh7b2/nonobench_v12_43_llms_on_nonogram_puzzles
