News Score: Score the News, Sort the News, Rewrite the Headlines

German AI consortium releases Soofi S, an open 30B model that tops benchmarks in both English and German

Update from July 15, 2026: After launch, critics argued that Soofi S was heavily "overtrained" by the standards of the classic Chinchilla scaling laws. Google DeepMind published those laws in 2022, describing how to balance model size and training data for a fixed compute budget. The sweet spot they identified was roughly 20 tokens per parameter. Soofi S blows past that ratio. With about 27 trillion tokens and 30 billion parameters, it lands at several hundred to one. Factor in only the 3.2 bill...

Read more at the-decoder.com

© News Score  score the news, sort the news, rewrite the headlines