Human conversations are fast, typically around 200ms between turns, and we think LLMs should be just as quick. This site provides reliable measurements for the performance of popular models. Definitions, methodology, and links to source below. Stats updated daily. Have another model you want us to benchmark? File an issue on GitHub. Definitions =========== Model: The LLM used. TTFT: Time To First Token. This is how quickly the model can process the incoming request and begin to output text, ...