Definition

Hallucination

A hallucination is a confident, fluent statement that is false: invented citations, made-up statistics, misattributed quotes. It happens because the model's objective is to predict the most plausible next token, not to be truthful, and benchmarks reward answering over admitting ignorance. The book treats hallucination as a constraint to manage rather than a bug to fix; RAG, evals, and guardrails exist because of it.

Explained in

Chapter 5: Inside the Machine

Everything you need to know about what's happening inside the box. No PhD required.

Related terms

This is one term. The chapter is the argument.

Intelligence at Scale: 22 chapters, 65,000 words, 80-plus diagrams. Kindle, paperback and hardcover on Amazon.

Buy on Amazon.com
← All terms