Metrics question
Define the goals and success metrics for a product focused on scam prevention within a platform like Meta.
- Meta
- Metrics
- Medium
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Metric design for a trust and safety product, balancing user protection with false positive costs.
How to approach it
- Clarify scope: which surface, for example Marketplace or Messenger, and which scam types, like fake sellers or phishing links.
- State the goal: reduce user financial and personal harm from scams while minimizing friction for legitimate users.
- Define a primary metric, such as reported scam rate per 1,000 transactions or messages.
- Add guardrails: false positive rate on flagged legitimate accounts and appeal resolution time.
- Include a leading indicator, like model precision on known scam patterns, to catch issues before harm scales.
What a strong answer includes
- Balances harm reduction against user friction, proposing both a scam rate metric and a false positive guardrail so genuine sellers are not overblocked.
- Uses a concrete illustrative target, for example cutting reported Marketplace scams by 30% while keeping false flags under 2%.
- Separates detection speed, time to flag, from resolution speed, time to remove or warn, since both matter to user trust.
Common mistakes
- Optimizing only for scams caught while ignoring false positives that hurt honest users.
- Measuring policy actions taken instead of actual reduction in user harm.
Likely follow-up questions
- How would you measure scams that go unreported?
- How would you balance automation speed against accuracy?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- How would you measure improvements made to Facebook messenger?Meta · Metrics · Easy
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You are the PM of Instagram app. The MAU has been constant but DAU has declined. What will you do?Meta · Metrics · Medium
More questions from Meta
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop