Metrics question
Android weekly usage dropped all of a sudden. How do you find out what happened?
- Meta
- Metrics
- Medium
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Root cause analysis for a metrics drop: structuring a debugging investigation methodically rather than guessing at causes.
How to approach it
- Confirm the drop is real: rule out data pipeline or instrumentation errors before investigating product causes, a common false alarm.
- Segment the drop: check if it is uniform across regions, device types, app versions, or user cohorts, since a localized drop points to a different cause than a global one.
- Check for a recent change: correlate the timing with recent app releases, OS updates, or Android policy changes, since a shipped bug is the most common cause of a sudden drop.
- Check external factors: competitor launches, negative press, or platform-level issues like Play Store policy changes or outages.
- Once the cause is narrowed, quantify severity and decide urgency: a widespread crash needs an immediate hotfix, while a gradual regional dip needs deeper investigation.
- Propose next steps: rollback the suspected release if correlated, or run a targeted user survey if the cause remains unclear.
What a strong answer includes
- Starts by ruling out instrumentation and data pipeline errors, a step many candidates skip, before jumping to product hypotheses.
- Segments by app version explicitly, since 'sudden' drops correlated with a release are the most common and most actionable cause.
- Distinguishes triage urgency, a crash needs a rollback today, a slow regional dip needs research, rather than treating all drops the same.
Common mistakes
- Jumping straight to product hypotheses without first checking if the data itself is trustworthy.
- Failing to segment the data, which can hide the real, narrower cause behind an aggregate number.
Likely follow-up questions
- What would you do in the first hour after noticing this drop?
- How would you distinguish a genuine usage drop from a measurement error?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- How would you measure improvements made to Facebook messenger?Meta · Metrics · Easy
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You are the PM of Instagram app. The MAU has been constant but DAU has declined. What will you do?Meta · Metrics · Medium
More questions from Meta
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop