We Have Made No Progress Toward AGIAnthropic has a new paper, On the Biology of a Large Language Model, that reveals what these AI models are internally “thinking” in a way that could not be analyzed before. We no longer have to guess by analyzing external behavior; now we can take a peek into the reasoning processes happening within the black box of the LLM and inspect to what degree LLMs possess any mechanistic understanding.What is revealed is that these models do not reason at all in the way...