Researchers run high-performing large language model on the energy needed to power a lightbulb
Large language models such as ChaptGPT have proven to be able to produce remarkably intelligent results, but the energy and monetary costs associated with running these massive algorithms is sky high. It costs $700,000 per day in energy costs to run ChatGPT 3.5, according to recent estimates, and leaves behind a massive carbon footprint in the process.In a new preprint paper, researchers from UC Santa Cruz show that it is possible to eliminate the most computationally expensive element of runnin...
Read more at news.ucsc.edu