Metrics question
What goals would you set for the Reels recommendation engine?
- Meta
- Metrics
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Ability to set goals for a recommendation engine that balance short-term engagement against long-term content ecosystem health.
How to approach it
- Identify the two sides the engine must serve: viewers wanting relevant, enjoyable content, and creators needing fair discovery to keep producing Reels.
- Propose a primary viewer-side goal: session-level watch time or completion rate per Reel served, reflecting genuine relevance, not just autoplay continuation.
- Propose a creator-side goal: the share of impressions going to mid-tier and new creators, not just already-viral content, to keep the content ecosystem healthy.
- Add a quality guardrail: rate of user-reported low-quality or repetitive content, since a pure watch-time optimization can degrade content diversity over time.
- Explain the tension explicitly: optimizing purely for watch time tends to concentrate attention on a small set of viral creators, so the creator-fairness goal exists specifically to counter that.
What a strong answer includes
- Names goals for both sides of the marketplace, viewers and creators, not just a single engagement number.
- Explicitly states the tension between pure engagement optimization and content ecosystem health, a sophisticated point on recommendation systems.
- Adds a concrete quality guardrail rather than only chasing watch time.
Common mistakes
- Naming only viewer-side engagement metrics, ignoring the creator-fairness and content-diversity side of a recommendation engine's health.
- Not acknowledging the trade-off between engagement and diversity, a well-known failure mode of recommendation systems.
Likely follow-up questions
- How would you detect if the algorithm is over-favoring a small set of viral creators?
- How would you balance new-creator discovery against showing viewers content they're most likely to enjoy?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- How would you measure improvements made to Facebook messenger?Meta · Metrics · Easy
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You are the PM of Instagram app. The MAU has been constant but DAU has declined. What will you do?Meta · Metrics · Medium
More questions from Meta
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop