Learning objectives
- • Choose a serving pattern from latency, freshness, cost, and reliability constraints
- • Design fallbacks for model, feature, and dependency failures
- • Explain canary, shadow, and A/B model rollouts
MLOps
Model Serving Patterns
Compare batch, online, streaming, edge, shadow, canary, blue-green, and async serving patterns.
Recommended on day 33100 minutesAdvanced
Interview prompts
- • When should a model be served asynchronously?
- • How do you safely canary a new ranking model?
Prerequisites