Unseen tasks10-minute horizonsOne video promptNo post-training13-minute readIntroduction The evolution of language modeling provides a blueprint for turning capable models into useful general-purpose tools. Earlier approaches based on transformers, such as BERT (Devlin et al., 2019), proved effective at understanding language, but each new application still demanded additional data collection and fine-tuning of the model. The pivotal transition from such early language models to ChatGPT was driv...