Day 20: AI System Design Patterns

🎯 Cieľ dňa

Ovládnuť production patterns pre resilientné AI systémy: caching (semantic + exact), circuit breakers, a graceful degradation.

core practice

Semantic cache: rozumie meaning, nie len exact match. Cache hit: 2-4x rýchlejšie, optimal 50-100x.

SemanticCache interface: auto-index, cosine similarity threshold, TTL. Production-ready.

Kedy retry, kedy fallback, kedy circuit break. Decision framework.

Hands-on: implementácia semantic cache. 62% hit rate, ~$11 vs ~$30 bez cache.

Semantic Caching — Vector similarity pre cache lookup. +5-20ms overhead, -1-5s na cache hit. 62% hit rate v produkcii.

Circuit Breaker — Closed → Open → Half-Open. Keď failures prekročia threshold, cut traffic. Prevent cascade.

Graceful Degradation — Namiesto failure, sliž service level: Opus → Sonnet → Haiku → cached response → static fallback

Retry Strategies — 70-80% transient failures sa vyriešia za sekundy. Exponential backoff + jitter je standard.

Implementuj caching a circuit breaker pre LLM API.