Table of ContentsThe State of Generative ModelsLanguageArchitectureDense TransformerMixture-of-ExpertsTokenizationReasoningDistillationImageArchitectureFrameworkMultimodalityVisual Language ModelsOmni-Modal ModelsAgents and Human-AI Interfaces2025In the face of disruptive technologies, moats created by closed source are temporary.Even OpenAI’s closed source approach can’t prevent others from catching up.So we anchor our value in our team — our colleagues grow through this process,accumulate know...