Cutting LLM API Costs: Prompt Caching, Batching and Smaller Models
An LLM bill grows faster than traffic. Here's how prompt caching, the Batch API and smaller models cut it, with real prices, tested Python c...
Nov 5, 2026
17 min
Prompt Caching: Your Prompt's Prefix Is a Cache Key
Prompt caching can cut repeated input costs by around 80%, but only if your prompt is ordered so the stable parts come first. Here's how it ...
Oct 31, 2026
4 min
Introducing GPT-6 Sol and Luna: What OpenAI's Cheaper Tier Means for Builders
OpenAI cut GPT-6 Sol and Luna prices in half, improved caching for agent workloads, and published alignment numbers worth reading before gra...
Sep 23, 2026
6 min
Token Budgeting: The Engineering Skill Nobody Talks About
Most developers think token optimization means shorter prompts. In 2026, the biggest costs come from bloated chat history, unused tool schem...
Jun 18, 2026
10 min