TL;DR: Dynalang leverages diverse types of language to solve tasks by using language to predict the future via a multimodal world model. To interact with humans and act in the world, agents need to understand the range of language that people use and relate it to the visual world. While current agents learn to execute simple language instructions from task rewards, we aim to build agents that leverage diverse language that conveys general knowledge, describes the state of the world, provides int...