Metrics question
You released a new feature on Facebook Stories that led to 5% decrease in number of active creators but a 10% increase in the number of daily active users. Would you roll this feature back?
- Meta
- Metrics
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Metrics judgment and trade off reasoning: can you weigh a creator side loss against a broader engagement gain rather than reading one metric in isolation.
How to approach it
- Clarify what each metric represents: active creators drives future content supply, DAU reflects current engagement and ad revenue.
- Check statistical and practical significance of both changes before deciding anything, since 5 percent and 10 percent need context on baseline size.
- Investigate why creators dropped, for example the feature made posting less visible or rewarding for them specifically.
- Weigh long term risk: fewer creators today can shrink content supply and hurt DAU later, even if DAU is up now.
- Propose a middle path before fully deciding: keep the feature for consumers but adjust it to protect creator incentives, then re measure.
- State your recommendation, provisionally keep and iterate rather than a flat rollback, given upside is real but the creator drop is a leading risk indicator.
What a strong answer includes
- Does not treat DAU as automatically outweighing creator loss, recognizing creators are the supply side of the whole product.
- Proposes investigating causation before deciding, rather than reacting to the two numbers alone.
- Recommends a specific middle path, iterate rather than binary keep or kill, which shows product judgment.
Common mistakes
- Automatically rolling back because one metric moved negative, without weighing the DAU gain.
- Automatically keeping the feature because DAU rose, ignoring the leading risk in creator supply.
Likely follow-up questions
- How would you separate correlation from causation in the creator drop?
- What time horizon would you give this before making a final call?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- How would you measure improvements made to Facebook messenger?Meta · Metrics · Easy
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You are the PM of Instagram app. The MAU has been constant but DAU has declined. What will you do?Meta · Metrics · Medium
More questions from Meta
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop