Metrics question
How will you evaluate the option of making a profile picture optional during user signup?
- Meta
- Metrics
- Medium
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Experimentation and metrics judgment: can you design a rigorous evaluation for a signup flow change with the right primary and guardrail metrics.
How to approach it
- State the hypothesis: making profile pictures optional lowers signup friction and increases completion rate.
- Set the primary metric as signup completion rate, since that is the direct target of the change.
- Add guardrail metrics: early retention (day 7 return rate) and content engagement, since profile pictures may drive social trust and connection quality.
- Design an A/B test, optional versus required picture, with a large enough sample to detect a meaningful lift.
- Segment results by new user cohort behavior, since users who skip a picture may behave differently downstream.
- Decide the rollout rule in advance, for example ship if completion rises without a meaningful drop in week one retention.
What a strong answer includes
- Balances the obvious short term win, more signups, against a real downstream risk, weaker profiles hurting trust or engagement.
- Proposes a concrete guardrail metric, day 7 retention, not just watches signup numbers alone.
- Sets a decision rule before running the test, avoiding post hoc rationalization.
Common mistakes
- Only measuring signup completion and ignoring downstream retention or trust effects.
- No predefined success threshold, leading to ambiguous interpretation after the test.
Likely follow-up questions
- What would you do if signups rise but retention drops slightly?
- How long would you run this test before deciding?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- How would you measure improvements made to Facebook messenger?Meta · Metrics · Easy
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You are the PM of Instagram app. The MAU has been constant but DAU has declined. What will you do?Meta · Metrics · Medium
More questions from Meta
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop