Researchers scale Ring-Zero AI to 1 trillion parameters using zero reinforcement learning, achieving emergent reasoning behaviors including self-verification and parallel thinking without human-annotated training data.

Ring-Zero: Scaling Zero RL to a Trillion Parameters for Emergent Reasoning

Authors:Xinyu Tang, Gangqiang Cao, Yurou Liu, Yuliang Zhan, Xiaochong Lan, Yifan Li, Yuchen Yan, Han Peng, Zican Dong, Zhenduo Zhang, Tianshu Wang, Xinyu Kong, Zujie Wen, Wayne Xin Zhao, Zhiqiang Zhang, Jun Zhou View PDF HTML (experimental) Abstract:Reinforcement learning with verifiable rewards without human-annotated data, often referred to as zero RL, has emerged as a powerful paradigm for eliciting chain-of-thought reasoning. However, due to computational constraints, existing studies are la...