"Chinese Startup 01.AI Follows Common Practices in Building Yi-34B Model on Meta's Llama 2 Framework, Not an American Tech Dependence: EleutherAI Debunks NYT's Report"

Yi-34B, Llama 2, and common practices in LLM training: a fact check of the New York Times

On February 21 2024, the New York Times published “China’s Rush to Dominate A.I. Comes With a Twist: It Depends on U.S. Technology.” The authors claim that Yi-34B, a recent large language model by the Chinese startup 01.AI, is fundamentally indebted to Meta’s Llama 2: There was just one twist: Some of the technology in 01.AI’s system came from Llama. Mr. Lee’s start-up then built on Meta’s technology, training its system with new data to make it more powerful. This assessment is based on a misre...