News Score: Score the News, Sort the News, Rewrite the Headlines

1-bit LLMs Could Solve AI’s Energy Demands

Large language models, the AI systems that power chatbots like ChatGPT, are getting better and better—but they’re also getting bigger and bigger, demanding more energy and computational power. For LLMs that are cheap, fast, and environmentally friendly, they’ll need to shrink, ideally small enough to run directly on devices like cellphones. Researchers are finding ways to do just that by drastically rounding off the many high-precision numbers that store their memories to equal just 1 or -1.LLMs...

Read more at spectrum.ieee.org

© News Score  score the news, sort the news, rewrite the headlines