44% on ARC-AGI-1 in 67 cents
I trained a small transformer from scratch in 1.5hrs on a 5090 Beats many LLMs, and scores the same as TRM/HRMThis is an upgrade to my previous model Faster, better, cheaper and still open source.Also gets 7% on ARC-2Discussion on Twitter, Code on github Performance on ARC-1 public eval. I only compare against models that do similar test time training This is the 3rd blog in a series of works on ARC-AGI. Prev: Blog 2, Blog 1.Many ppl thought the prev result was impossible. It got attention fro...
Read more at mvakde.github.io