Definition

Chain-of-Thought

Chain-of-thought prompting asks the model to reason step by step before answering, in its simplest form by appending "Let's think step by step." Because tokens are generated sequentially, the intermediate reasoning becomes context for the final answer, effectively a scratchpad. Accuracy on math and logic problems can jump 20 to 40 percent with no model change. Reasoning models later built this behavior into training.

Explained in

Chapter 8: Prompt Engineering and Context Engineering

The number one practical skill for anyone working with AI.

Related terms

This is one term. The chapter is the argument.

Intelligence at Scale: 22 chapters, 65,000 words, 80-plus diagrams. Kindle, paperback and hardcover on Amazon.

Buy on Amazon.com
← All terms