Model Management
Detection model lifecycle
Training → Tuned → ShadowMode → Active → Retired · dual-control on promotion (CR-005)
Lifecycle pipeline
Training
Tuned
ShadowMode
Active
Retired
Shadow agreement
97.4%
▲ 0.6 pts · ready to promote
Target ≥97% (CR-001)
Precision · shadow
94.1%
▲ 1.1 pts vs prod
7-day rolling
Recall · shadow
89.2%
▲ 2.4 pts vs prod
vs analyst-confirmed labels
FPR drift · High-LTV
+0.08 pts
Acceptable, monitor
Stability check (CR-007)
Model versions
| Version | State (WS-004) | Training data window | Precision | Recall | FPR (High-LTV) | Activated | Approver | Actions |
|---|---|---|---|---|---|---|---|---|
| scoring-v4.8-shadow | ShadowMode | 2024-11 → 2025-04 | 94.1% | 89.2% | 0.36% | — | R. Patel | |
| scoring-v4.7-prod | Active | 2024-09 → 2025-03 | 93.0% | 86.8% | 0.44% | 2025-04-22 | R. Patel + S. Liu | |
| scoring-v4.8-tuned | Tuned | 2024-11 → 2025-04 | — | — | — | — | R. Patel | |
| scoring-v4.9-train | Training | 2024-12 → 2025-05 | — | — | — | — | — | |
| scoring-v4.6-archive | Retired | 2024-07 → 2025-01 | 91.3% | 83.6% | 0.51% | 2025-03-22 | R. Patel + M. Cohen |
Precision & recall by LTV tier · shadow vs production
v4.7 Production
v4.8 Shadow
Shadow agreement over 14 days
Crossed 97% threshold on day 9 · sustained above target for 5 consecutive days · eligible for promotion review.
Recent lifecycle events (audit)
View full log →| When | From → To | Model | Actor | Co-approver | Ref |
|---|---|---|---|---|---|
| 2025-05-11 09:12 | Tuned → ShadowMode | v4.8 | R. Patel | S. Liu | aud_8721 |
| 2025-05-08 17:30 | Training → Tuned | v4.8 | System (auto) | — | aud_8588 |
| 2025-04-22 14:02 | ShadowMode → Active | v4.7 | R. Patel | S. Liu | aud_8401 |
| 2025-04-22 14:02 | Active → Retired | v4.6 | R. Patel | S. Liu | aud_8402 |