News Score: Score the News, Sort the News, Rewrite the Headlines

Watching a language model think before it speaks

Projects A 4B model, a lens on its residual stream, and a browser tab where the words show up in its head a beat before they show up in its mouth. I typed "Is this correct? 12 + 5 = 1" and hit enter, and before the model wrote a single character of a reply, three words were already sitting in a little panel off to the side: math, addition, incorrect. It hadn't said anything yet. It was still reading my message. But it had clearly already made up its mind, and I was watching that happen, live, on...

Read more at blog.nathanlangley.dev

© News Score  score the news, sort the news, rewrite the headlines