“If anything we are seeing the emergence of a new scaling law with test time or inference time compute“ – Microsoft CEO Satya Nadella, Tuesday November 19 at Microsoft IgniteScaling laws were supposed to be, well, laws. Mathematical laws. Pretty much the entire GenAI frenzy has been based on the idea that with reasonable precision you could predict performance from amount of data, number of parameters, and amount of compute. As recently as a few weeks ago, Sam Altman was extolling scaling laws ...