Graded against final scores as games are played, updated every Sunday alongside the new predictions. ATS is whether the model picked the covering side of the Vegas home line.
Both models are scored on an honest holdout: train on seasons through 2023, early-stop on the next season, then measure 2025 — a year the booster never sees while trees or hyperparameters are chosen. The production models are then retrained on every season through 2025.
LightGBM classifier on 844 2025 games. Production fit uses 8,513 games, 325 features, 109 trees.
Isotonic calibration on 2024 raised holdout Brier from 0.194 to 0.199, so the shipped model uses raw probabilities.
LightGBM regressor predicting home minus away, scored on the same 844 2025 games. MAE and RMSE are in points.