Metrics question
Zoom has integrated AI into their system, which includes automated notes, and since then, the number of meetings has reduced. What will you do?
- Zoom
- Metrics
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Tests diagnosing whether a usage decline caused by a feature is actually good or bad for the business, requiring reframing the problem.
How to approach it
- Question the framing first: fewer meetings could mean the AI notes feature is working exactly as intended, reducing unnecessary meetings.
- Segment meetings avoided because notes made them unnecessary, a good outcome, from meetings avoided due to dissatisfaction or churn risk, a bad one.
- Check business impact: does reduced meeting volume correlate with reduced subscription usage or renewal risk, or is overall engagement stable.
- Recommend shifting the north star from meeting count to value delivered per user, time saved or task completion, since the feature's own success makes meeting count outdated.
- Define success as retention and renewal rate and NPS post-feature, not raw meeting count.
What a strong answer includes
- Explicitly reframes the premise, fewer meetings isn't automatically bad, rather than panicking at the metric drop.
- Proposes checking renewal and retention as the metric that actually matters for Zoom's revenue model.
- Draws a clear line between good-cause and bad-cause reductions in meeting volume.
Common mistakes
- Assuming fewer meetings is automatically bad and encouraging more meetings, contradicting the product's own value proposition.
- Not checking whether retention or revenue is actually affected before reacting.
Likely follow-up questions
- How would you distinguish meetings avoided because AI notes replaced them from meetings avoided due to churn risk?
- What metric should replace meeting count as the real north star here?
More metrics questions
- How would you measure the success of Meta's AI features?Zoom · Metrics · Medium
- Zoom has introduced a new feature that allows users to send emoji reactions during meetings. How would you assess the effectiveness of this new feature?Zoom · Metrics · Medium
- How would you measure customer success for a newly launched product?Zoom · Metrics · Medium
- Assume that you are a product manager at Zoom. Design a better experience for teachers using Zoom to conduct online classes.Zoom · Metrics · Medium
- How would you measure the performance and health of a Netflix Original?Microsoft · Metrics · Hard
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
More questions from Zoom
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop