Watching a language model think before it speaks
Projects
A 4B model, a lens on its residual stream, and a browser tab where the words show up in its head a beat before they show up in its mouth.
I typed "Is this correct? 12 + 5 = 1" and hit enter, and before the model wrote a single character of a reply, three words were already sitting in a little panel off to the side: math, addition, incorrect. It hadn't said anything yet. It was still reading my message. But it had clearly already made up its mind, and I was watching that happen, live, on...
Read more at blog.nathanlangley.dev