Metrics question
You are PM of FB Login used by 3rd parties and you notice successful logins metrics is down on a Monday morning. What will you do?
- Meta
- Metrics
- Medium
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Structured incident investigation for a sudden metric drop in an authentication system used by third parties.
How to approach it
- Confirm the drop is real and not a measurement artifact, checking dashboards, logging pipeline health, and time zone alignment.
- Segment the drop by geography, platform (web versus mobile), and specific third-party apps to see if it is global or localized.
- Check for a recent deploy or config change to the login service or SDK that could have shipped over the weekend.
- Check dependent systems: OAuth token issuance, rate limiting, or a partner API change that could reject valid logins.
- Correlate with error logs, since a spike in specific error codes points to a technical cause versus genuine reduced usage.
- Based on findings, roll back a change, fix a broken dependency, or investigate a behavioral cause if usage is genuinely down.
What a strong answer includes
- Starts by validating the metric itself before investigating causes, catching false alarms many candidates skip.
- Segments systematically by geography, platform, and third-party app to localize the issue before theorizing.
- Ties the Monday-morning timing to a plausible, specific hypothesis, a weekend deploy, rather than a vague one.
- Distinguishes a technical failure from genuine behavioral change, which require very different fixes.
Common mistakes
- Assuming the drop is real without first checking for a data or logging pipeline issue.
- Jumping to a root cause without segmenting where the drop is concentrated.
- Not considering third-party or dependency changes outside the company's own deploys.
Likely follow-up questions
- How would you distinguish a genuine usage decline from a broken metric pipeline?
- What would you tell affected third-party developers while investigating?
- How would you prevent this from happening again after you find the cause?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- How would you measure improvements made to Facebook messenger?Meta · Metrics · Easy
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You are the PM of Instagram app. The MAU has been constant but DAU has declined. What will you do?Meta · Metrics · Medium
More questions from Meta
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop