Why Are the Critical Value and Emergent Behavior of Large Language Models (LLMs) Fake?
Why there are no emergent properties in Large Language Models.
We heard lot about emergent properties of Large Language Models (LLMs) last year. I will share with you my thoughts, and some other scientists, of why there are no emergent properties and especially why the assumed critical value that these so-called emergent properties are based upon is not substantial.
The excitement about emergent properties started with a paper by [1], where the authors show that scaling LLMs beyond a specific si...
Read more at cacm.acm.org