#deep-learning

Understanding the Internal Mechanics of LLMs

A grounded tour of tokenization, transformer blocks, causal attention, training, inference, KV caches, scaling, and quantization.