I Built the Smallest LLM I Could to Understand How They Work
I use LLMs every day without knowing how they work, so I built the smallest one I could: a tiny transformer that writes Shakespeare one char...
Oct 23, 2026
9 min
Build a Small LLM From Scratch: A Tested GPT in PyTorch
A practical, fully tested GPT implementation in PyTorch with causal attention, training, sampling, baselines, checkpoints, and 25 tests. Tra...
Oct 1, 2026
19 min