This Startup Wants To Power The Next Big Wave Of AI: Actually Making It Useful
Baseten's cofounders are (from left) Amir Haghighat, Tuhin Srivastava, Phil Howes and Pankaj Gupta.SLCA Studios
Companies have spent billions on computing costs to train artificial intelligence models, but the costs are starting to shift to when the AI is actually used — say, the compute ChatGPT uses to answer a question in real time. That process, called “inference,” accounted for 40% of Nvidia’s computing revenue last year, the company shared in its latest earnings report. “If Nvidia’s busines...
Read more at forbes.com