mlb/total_runs
The ledger row, decomposed. Every figure below is read from a staged artifact on disk (cited per panel); this drill describes calibration and sharpness only -- no dollar edge, ROI, or bankroll is claimed.
- model
- 2.9331 (CRPS)
- market
- 2.8808 (CRPS)
- delta (95% ci)
- -0.0523 [-0.1657, 0.0482]
- n
- 300
verdict UNDERPOWERED -- source scripts/platformkit/benchmarks/crps_market/last_run_mlb.json
Murphy decomposition (model)
Brier = reliability - resolution + uncertainty (10-bin). Lower reliability and higher resolution are better; uncertainty is the irreducible base-rate floor. Descriptive, not an edge claim. Source: murphy_decomposition.json.
reliability curve (model vs market)
as of 2026-09-16
Predicted probability (x) vs observed frequency (y) against the perfect-calibration ideal (dashed). Amber = model, blue = market. Hover a point for its bin count. Source: calibration_stability.json.
bootstrap CI per bin (model)
as of 2026-09-16
| bin | n | gap | gap 95% ci | excludes 0? |
|---|---|---|---|---|
| 0.0-0.1 | 2072 | 0.0119 | [-0.037, 0.082] | no -- within noise |
| 0.1-0.2 | 1900 | -0.1099 | [-0.153, -0.046] | yes -- gap real |
| 0.2-0.3 | 1774 | -0.1384 | [-0.216, -0.045] | yes -- gap real |
| 0.3-0.4 | 2217 | -0.1232 | [-0.230, 0.014] | no -- within noise |
| 0.4-0.5 | 3859 | -0.0867 | [-0.220, 0.051] | no -- within noise |
| 0.5-0.6 | 5636 | 0.0087 | [-0.103, 0.122] | no -- within noise |
| 0.6-0.7 | 4026 | -0.0043 | [-0.147, 0.134] | no -- within noise |
| 0.7-0.8 | 2024 | 0.0752 | [-0.038, 0.177] | no -- within noise |
| 0.8-0.9 | 2406 | 0.0927 | [0.030, 0.138] | yes -- gap real |
| 0.9-1.0 | 1437 | 0.0282 | [-0.006, 0.049] | no -- within noise |
3/10 eligible bins have a calibration-gap 95% CI (cluster bootstrap on game_id) that excludes 0; the rest are within noise. Model Brier 0.1668. Brier skill vs climatology 0.333, vs market -0.104 (at or below 0 -- the model does not beat the market Brier; that null is the point). Source: calibration_stability.json + brier_skill_scores.json.