THE ANALYSTANALYTICAL WORK SIMULATIONS
OPEN WORKBENCH ↗
ASSIGNMENT REGISTER

ML GOVERNANCE / INCOMING BRIEF

Too Good to Ship

Audit an implausibly strong cancellation model and decide its smallest safe path forward.

ACCEPT THE ASSIGNMENT PASS THE BRIEF

Preview anywhere. Complete the work in a current laptop or desktop browser.

ASSIGNMENT
MR-260120
YOUR ROLE
Model Risk Analyst
WORKLOAD
8–14 hours
prepared learner
COMPLEXITY BAND
Practicum
01 / SITUATION

THE OPERATING MOMENT

The decision is already in motion.

A cancellation model has exceptional validation results and a production deadline. Its performance is also good enough to deserve suspicion.

YOUR MANDATE

Trace lineage and point-in-time availability, reproduce the apparent performance, and define the smallest safe path forward.

02 / OPERATING CONDITIONS

WHAT THE WORK DEMANDS

Interrogate before you recommend.

You receive access to a bounded part of Meridian’s synthetic enterprise estate. The briefing defines the decision—not the analytical path or a preferred answer.

SQL / EVIDENCE CONSTRUCTION

Establish the facts.

Trace model lineage, snapshot grain, labels, and point-in-time availability.

PYTHON / ANALYTICAL JUDGMENT

Stress-test the decision.

Reproduce leakage, compare grouped temporal validation, build an allow-listed baseline, and audit calibration and segments.

CAPABILITY PROFILE1 FOUNDATION / 5 ADVANCED
SQL3/5
Python5/5
Data complexity5/5
Statistical reasoning5/5
Decision ambiguity5/5
Deliverable load5/5
03 / READINESS

BEFORE YOU ACCEPT

Know the neighborhood.

This is an open-ended workplace simulation. You can inspect the available schemas and tables before committing to an approach, but the brief intentionally does not identify every useful field or analytic test.

RECOMMENDED PREREQUISITES
  • Model validation
  • Temporal splits
  • Calibration
  • Data governance
DATA NEIGHBORHOOD

5 tables across 3 schemas

  • platform.account_feature_snapshot
  • platform.model_registry
  • platform.model_version
  • crm.account_status_event
  • billing.subscription_event
TUESDAY, 20 JAN / 09:15

Take the desk as Model Risk Analyst.

Your SQL, Python, notes, evidence, figures, and final handoff stay in your browser until you choose to export them.

OPEN WORKBENCH
FORWARDING DESK / OPTIONAL

CHALLENGE A COLLEAGUE

Pass the Brief

Send the same decision pressure to someone else. The link opens this spoiler-free briefing; it does not include your work, identity, or progress.

SUGGESTED NOTE

The model looks too good to fail. Is it safe to ship? Take the model-risk practicum in The Analyst.

EMAIL
MORE WAYS TO PASS THE BRIEF