Product Recommendations
HealthyReal-time production health
Known immediately — no outcomes needed.
Predictions / hour
Latency
Inputs, context & predictions
Input drift vs reference (PSI)
Prediction distribution
Routing
- Backend
- Managed by Zero Grad
- Context
- pinned to v12
- Fallback on timeout
- Managed C · 0.02% of requests
Matured outcome quality
Performance metrics are computed only for predictions with observed outcomes. Clicks and purchases attributed within 7 days take up to ~7 days to arrive, so recent predictions aren't scored yet.
Business impact
Sep 17 – Sep 23 · 94% coverageIncremental revenue estimated against a 5% popularity-baseline holdout.
Model quality
Sep 17 – Sep 23NDCG@10 — matured outcomes
By prediction day. Recent cohorts are provisional until their outcomes arrive.
Outcomes
Ground truth flows back by prediction_id. It improves evaluation and routing — never model weights.
Send outcomes
Every prediction returns a prediction_id. Send the real outcome whenever you learn it.
# Later, when the real outcome is known
zg.capability("product-recommendations").send_outcomes([
{"prediction_id": "pred_01J9X4R3TC", "outcome": {"purchased": "sku_44120"},
"observed_at": "2026-09-30T23:41:00Z"},
])Outcomes never update model weights — Zero Grad does not train a customer-specific model. They are used to measure real production quality, compare foundation models and context-selection strategies, improve routing, and decide whether a challenger beats the current production configuration.
What Zero Grad learned from your outcomes
No training doesn't mean no learning.
- Context length: the last 50 events match 200 events on matured purchases, at 40% lower latency.
- Cold-start users routed to the co-occurrence baseline: same CTR, 7× cheaper.
- Session events in context lift CTR on matured sessions (v13 experiment, day 4 of 14).
What adapts: which foundation model serves which slice, how in-context examples are selected, and calibration. What doesn't: model weights.