Definition

Test-Time Compute

Test-time compute is the third scaling frontier: letting a model think longer at inference time instead of only making it bigger or training it more. Reasoning models such as o1, o3, and DeepSeek R1 generate an internal chain of thought before answering, sometimes for minutes, and outperform larger models on math, code, and logic. For builders it adds a new design axis: how long should this query think?

Test-Time Compute diagram from Intelligence at Scale
Diagram from chapter 7, The New Landscape

Explained in

Chapter 7: The New Landscape

The current state of AI. What's changed, what it means for builders.

Related terms

This is one term. The chapter is the argument.

Intelligence at Scale: 22 chapters, 65,000 words, 80-plus diagrams. Kindle, paperback and hardcover on Amazon.

Buy on Amazon.com
← All terms