
Build a Small LLM From Scratch: A Tested GPT in PyTorch
A practical, fully tested GPT implementation in PyTorch with causal attention, training, sampling, baselines, checkpoints, and 25 tests. Tra...

A practical, fully tested GPT implementation in PyTorch with causal attention, training, sampling, baselines, checkpoints, and 25 tests. Tra...

Part 3 of our Neural Network Series: why depth alone doesn't help without activation functions, how sigmoid and ReLU work in plain language,...

The first post in our Neural Network Series: how a single artificial neuron works, built from an everyday decision, then stacked into a full...

Alibaba just dropped the weights for Qwen3.8-Max — a 2.4 trillion parameter Mixture-of-Experts model that autonomously coded for 16 days str...