Metrics question

We are noticing a 10% drop in our check out page conversion rate. What would you do?

Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.

What this question tests

Whether the candidate can quickly triage a conversion drop on a critical revenue path, balancing urgency with rigor.

Confirm the drop is real: rule out a tracking or analytics bug first, since checkout is a high-stakes page where false alarms are common.
Segment the drop by device, browser, payment method, and geography to see if it's broad or localized to a specific path.
Check for a recent change: a checkout redesign, a new payment provider integration, or a pricing or fee change deployed around the same time.
Check external factors: a payment processor outage or a new fraud rule blocking legitimate transactions.
Prioritize a fast rollback if a recent change is the likely cause, then run a proper root cause investigation before any permanent fix.

Treats a fast rollback as a valid first response for a critical revenue path, not waiting for full root cause analysis before acting.
Segments by payment method specifically, since checkout drops are often caused by one broken payment path, not the whole flow.
Names a payment processor issue as a concrete, high-likelihood hypothesis to check first, given the context.

Spending too long on analysis before considering an immediate rollback for a revenue-critical page.
Not checking payment method segmentation specifically, where checkout issues often concentrate.

Chapters of the AI PM course that teach what this question tests.