Definition

Huang's Law

Huang's Law is Jensen Huang's claim that AI computing performance per dollar improves far faster than Moore's Law. The book decomposes NVIDIA's roughly 1,000x inference improvement over a decade into three compounding forces of about 10x each: better hardware, better software such as CUDA kernels and compilers, and better algorithms. This stacking is why an LLM query that cost dollars in 2020 costs fractions of a cent now.