transformers

Build a Small LLM From Scratch: A Tested GPT in PyTorch

A practical, fully tested GPT implementation in PyTorch with causal attention, training, sampling, baselines, checkpoints, and 25 tests. Tra...

Pradeep Kumar

Oct 1, 2026

19 min