Hacking Diffusion into Qwen3 for the ARC Challenge - Matthew Newton
Overview
I've been playing with the ARC AGI Prize recently1. There are a lot of things that surprised me while replicating the approach of last year's grand prize winner, "The ARChitects"2. For example, when the model was less sure about a pixel, the solution was more likely wrong. Another was that a per-pixel token encoding even worked. It was like the poor model was forced to type its solutions out, character by character, on a typewriter with no backspace.
Imagine solving a jigsaw puzzle but ...
Read more at matthewnewton.com