Metrics question
There is a 15% drop in the open rate of Instagram App. You are the PM. Tell us what could have happened.
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Structured diagnosis of a metric drop in a consumer app, distinguishing measurement, product, and external causes.
How to approach it
- Clarify the metric: open rate likely means sessions per notified or notification-eligible user, so confirm the exact definition first.
- Check for an instrumentation change, like a new event schema or a tracking SDK update, before assuming real behavior changed.
- Segment by platform, region, and whether the drop correlates with a recent app release or notification permission change (like iOS App Tracking Transparency).
- Check push notification delivery rates, since a drop in notifications sent or delivered would look like a drop in opens.
- Look at content quality signals, like whether feed content freshness or creator posting volume dropped, reducing the reason to open.
What a strong answer includes
- Flags OS-level changes, like notification permission prompts or iOS privacy changes, as a common real-world cause worth checking first.
- Separates 'fewer people notified' from 'notified people opening less,' since the fix differs for each.
- Gives an illustrative segmentation, e.g. the drop concentrated in one region after a local competitor launch, marked as an assumption.
- Proposes a guardrail dashboard split by notification type (post, DM, live) to isolate which trigger underperforms.
Common mistakes
- Assuming content quality dropped without first ruling out measurement or delivery issues.
- Not distinguishing open rate from raw session count, which can mask the real signal.
Likely follow-up questions
- How would you check if this is an iOS-specific issue?
- What would you look at first: notifications sent or notifications opened?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- How would you measure improvements made to Facebook messenger?Meta · Metrics · Easy
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You are the PM of Instagram app. The MAU has been constant but DAU has declined. What will you do?Meta · Metrics · Medium
More questions from these companies
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop