Capabilities · Forecasting
Weekly Demand Forecast
HealthyZero-shot forecastingEndpoint weekly-demandProduction v4Challenger v5
Weekly Demand Forecast / Deployments
Simulated
BLUE— Production
Healthyv4
- Traffic
- 100%
- WAPE
- 12.8%
- P95
- 380ms
- Cost / 1K
- $0.40
- Engine
- Managed A
- Created
- 5 weeks ago
GREEN— Candidate
Readyv5
- Traffic
- 0%
- WAPE
- 11.9%
- P95
- 410ms
- Cost / 1K
- $0.42
- Engine
- A + C · intermittent series routed to C
- Created
- 2 hours ago
Live traffic
BLUE v4100%
GREEN v50%
Deploy v5
Choose how the challenger reaches production
Production
v4
Challenger
v5
Customer responses still come from v4. v5 predictions are evaluated silently on 10% of mirrored requests.
No customer impact. Shadow traffic is billed at challenger cost.
Shadow results — 336 hoursRequests evaluated 25K series
Simulated| Metric | v4 | v5 |
|---|---|---|
| WAPE | 12.8% | 11.9% |
| Bias | 1.4% | 0.9% |
| Interval coverage | 91% | 90% |
| P95 latency | 380ms | 410ms |
| Cost / 1K | $0.40 | $0.42 |
✓P95 latency 410ms < 1000ms
✓Absolute bias 0.9% < 3%
✓Interval coverage 90% > 85%
✓Cost / 1K $0.42 < $1.00
v5 satisfies all configured production constraints.
Latency and cost are measured on live shadow traffic. Quality rows come from replaying both versions on predictions with matured outcomes (Aug 3 – Sep 20, 100% coverage) — outcomes for this shadow window arrive in ~9 days.
Version timeline
Today
- 12:00Backtest completed — v5 improved WAPE 12.8% → 11.9%
- 10:00v5 created — intermittent series routed to statistical baseline
Yesterday
- 06:20Late data from 2 stores — forecasts used last known values
5 weeks ago
- 11:00v4 promoted to production