Definition

Trace

A trace is one complete agent run: the user's input, every reasoning step, retrieval, tool call, and the final answer, captured as a single top-level record. It is the unit of AI observability, borrowed from OpenTelemetry's distributed tracing. When a customer gets a wrong answer, you open the trace and walk its spans to find whether retrieval, reasoning, or hallucination failed.

Trace diagram from Intelligence at Scale
Diagram from chapter 13, Production AI: Deployment, Monitoring, and Evaluation

Explained in

Chapter 13: Production AI: Deployment, Monitoring, and Evaluation

The reality of running AI agents. It's nothing like the demo.

Related terms

This is one term. The chapter is the argument.

Intelligence at Scale: 22 chapters, 65,000 words, 80-plus diagrams. Kindle, paperback and hardcover on Amazon.

Buy on Amazon.com
← All terms