Intermediate5 lessons~125 min
Patterns in Production
The four architectures that cover most real systems
Speculative fan-out, confidence-gated routing, composite scoring, and intent routing — implemented properly, with the failure modes each one hides.
What you’ll be able to do
- ✓Batch speculative questions without paying for them in latency
- ✓Set risk-scaled confidence thresholds instead of one global number
- ✓Move weighting logic out of prompts and into code you can tune
- ✓Put a cheap classifier in front of an expensive LLM
Lessons
- 0120m
Speculative Fan-Out
freeAsk everything you might need in one call. Discarding answers is cheaper than a second round trip.
- 0224m
Confidence-Gated Routing
paidThe answer tells you what; confidence tells you whether to act. Tune a two-axis gate interactively.
- 0322m
Composite Scoring
paidScore dimensions independently, weight them in code. Change priorities without touching a prompt.
- 0420m
Intent Routing
paidClassify first, then route to deterministic code, a specialist LLM, or a human.
- 0540m
Project: Moderation Pipeline
paidAn escalation ladder with per-action thresholds, an audit trail, and a human in the loop.