Metrics question

A metric for a video streaming service dropped by 80%. What do you do?

Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.

What this question tests

Structured root cause investigation for a severe, sudden metric collapse in a streaming product.

Confirm the metric and scope precisely: which metric (starts, completion, sign ups), which platform, and over what exact timeframe.
Rule out a measurement or instrumentation bug first, since an 80 percent drop is an extreme magnitude often caused by tracking failures.
If the drop is real, segment by platform (iOS, Android, web, smart TV), region, and content type to isolate where it concentrates.
Check for a recent deploy, app store outage, CDN or streaming infrastructure failure, since a drop this large usually has a single major cause.
Check external factors: a major competing event, an outage at a key content delivery partner, or a licensing issue pulling major content.
Escalate to an incident response process given the severity, with hourly updates until root cause is found and resolved.

Treats an 80 percent drop as almost certainly a technical or tracking failure first, correctly calibrating severity to likely cause.
Proposes segmenting by platform and region immediately, since a drop this severe is rarely uniform across the entire product.
Names concrete likely causes, a CDN outage or a broken app store build, showing real operational knowledge of streaming infrastructure.
Proposes escalating to a formal incident response process, appropriate given the severity of an 80 percent drop.

Treating an 80 percent drop as a normal business fluctuation instead of escalating it as a likely critical incident.
Not checking for tracking or instrumentation issues before assuming a real usage collapse.
No segmentation to isolate whether the drop is platform specific, regional, or truly global.

Chapters of the AI PM course that teach what this question tests.