Metrics question
Number of users on an Amazon website drops by 10%. What are the possible reasons, and how can we solve it?
- Amazon
- Metrics
- Medium
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Tests root-cause analysis for a moderate, broad traffic drop, structuring hypotheses before jumping to a fix.
How to approach it
- Clarify the metric: confirm whether users means unique visitors, logged-in sessions, or something else, and over what timeframe the 10% drop occurred.
- Rule out measurement issues: check for a tracking change, a tagging bug, or a bot-traffic filter update that could mechanically shift the count.
- Segment the drop: by traffic source, device, and region, since a broad drop concentrated in one channel points to a specific cause.
- Check external causes: an SEO ranking change, a paid marketing budget cut, a competitor promotion, or seasonal dip versus the prior comparable period.
- Check internal causes: a recent site redesign, a checkout or login flow bug, or a performance regression increasing bounce.
- Prioritize fast checks first, channel segmentation and a year-over-year comparison, then propose a fix path per confirmed cause.
What a strong answer includes
- Checks measurement validity before assuming real behavior changed, a step many candidates skip.
- Segments by channel, device, and region before hypothesizing a cause, avoiding a one-size explanation.
- Separates external causes from internal ones for a structured investigation.
- Proposes fast, cheap checks first, channel segmentation and year-over-year comparison, before slower diagnostics.
Common mistakes
- Jumping to a single guessed cause without segmenting the drop by channel or region first.
- Ignoring measurement or tracking issues as a possible explanation for the drop.
Likely follow-up questions
- How would you distinguish an SEO ranking drop from a paid budget cut?
- What would you check first if the drop were concentrated in mobile web only?
More metrics questions
- Walmart's order return rate is increasing. As a product manager, what things would you look into to isolate the problem?Amazon · Metrics · Medium
- One of the brands in the grocery category is not selling and has stocks left that are soon to expire. Specify all possible reasons for it and also suggest solutions for each of the reasons.Shopify · Metrics · Medium
- A metric for a video streaming service dropped by 80%. What do you do?Google · Metrics · Medium
- You are a PM for an e-commerce company. Due to some mistakes, the data team lost all key metrics. What are the metrics you will track as PM?Amazon · Metrics · Medium
- Your new feature boosts Amazon Search by 10%, adds 2s to load time. What do you do?Amazon · Metrics · Hard
- How would you change the Amazon Fresh experience and how would you measure them?Amazon · Metrics · Medium
More questions from Amazon
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop