Since the release of OpenAI o1, I have been working on reproducing o1 as a personal side-project during my spare time. Throughout this process, I’ve gained a lot of interesting knowledge and insights (and failures). Given the limitations of my abilities, time, and financial resources, it’s unlikely that I’ll be the one to take this effort all the way to the finish line. Therefore, I feel it’s important to share these experiences — worth the equivalent of dozens of H100 GPUs — while they’re still...