Build a Production Inference Engine from Scratch
The engine that serves a language model, built and verified one layer at a time.
The engines that serve large language models are treated as black boxes. This book opens one. You build a real inference engine a layer at a time: the forward pass, the KV cache, the kernels, the sampler, until a model you loaded yourself generates text on your own machine.
Every listing is real, runnable code, not pseudocode, and every result on the page is exactly what it produced.