OpenAI training and inference costs could reach $7bn for 2024, AI startup set to lose $5bn - report
OpenAI is set to spend billions of dollars on training and inference this year, and may be forced to raise more money to cover growing losses.The Information reports that, as of March, the company was set to spend nearly $4 billion this year on using Microsoft’s servers to run inference workloads for ChatGPT.A person familiar with the matter told the publication that OpenAI has the equivalent of 350,000 servers containing Nvidia A100 chips for inference, with around 290,000 of those servers used...
Read more at datacenterdynamics.com