Metrics question
Events usage, specifically, the "Yes, I'm going" usage is down significantly in the past three days. What would you do?
- Meta
- Metrics
- Medium
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Rapid metric diagnosis under a short, sudden decline window, structuring internal and external hypotheses quickly.
How to approach it
- Confirm the drop is real and check the measurement pipeline first, since a three day window is short enough for a tracking glitch.
- Check for recent product changes shipped in the last week, like a UI change to the RSVP button or Events flow.
- Segment the decline by platform and region to see if it is isolated or broad, which narrows the likely cause.
- Check for external factors, like a major news event or holiday period reducing event planning activity broadly.
- Prioritize the strongest hypothesis and propose an immediate mitigation, such as rolling back a recent change if it is implicated.
What a strong answer includes
- Moves fast given the short three day window, prioritizing a check of recent releases before deep analysis, since sudden drops often trace to a recent change.
- Segments by platform to catch a scenario like the RSVP button breaking on one app version.
- Proposes an immediate mitigation, like a rollback, rather than only a long term investigation plan given the urgency.
Common mistakes
- Treating a sudden, sharp drop the same as a gradual decline, missing that a recent change is the likely cause.
- Spending too long on broad analysis instead of first checking recent releases given the urgency of the signal.
Likely follow-up questions
- How would you decide whether to roll back immediately or investigate further first?
- How would you prevent this kind of regression from shipping in the future?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- How would you measure improvements made to Facebook messenger?Meta · Metrics · Easy
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You are the PM of Instagram app. The MAU has been constant but DAU has declined. What will you do?Meta · Metrics · Medium
More questions from Meta
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop