Metrics question
Avg comments on a news platform increased from 2 to 3 in 2 days time. What are your hypotheses?
- Meta
- Metrics
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Root cause hypothesis generation for a metrics change, distinguishing real signal from noise or measurement artifacts.
How to approach it
- Check if the change is statistically meaningful: a jump from 2 to 3 comments over just two days could be noise on small volume.
- Rule out measurement issues first, like a tracking change, a new comment feature launch, or a bot inflating counts.
- Consider content-side hypotheses: a viral or controversial story spiking comments on a subset of articles.
- Consider product-side hypotheses: a UI change making the comment box more visible, or a new notification prompting replies.
- Segment the increase by article category, device, and user cohort to see if it is broad or concentrated.
- Propose validating the top hypothesis with a quick data pull before proposing any product change.
What a strong answer includes
- Questions the statistical significance of the jump first, given it is a small base over just two days.
- Separates content driven causes, like one viral story, from product driven causes, like a UI change to the comment box.
- Proposes checking for bot or spam comment activity as a concrete, checkable hypothesis.
- Suggests segmenting by article topic and device to localize the source before acting.
Common mistakes
- Treating a two point average shift over two days as a confirmed trend without checking sample size.
- Jumping to a product explanation without first ruling out data or tracking issues.
Likely follow-up questions
- How would you confirm this is a real trend and not noise?
- What would you do if the increase were driven entirely by one viral article?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- How would you measure improvements made to Facebook messenger?Meta · Metrics · Easy
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You are the PM of Instagram app. The MAU has been constant but DAU has declined. What will you do?Meta · Metrics · Medium
More questions from Meta
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop