Metrics question
How would you measure the success of Shazam?
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Tests metrics design for a music recognition utility: distinguishing a north star from supporting and guardrail metrics for a single-purpose app.
How to approach it
- State Shazam's core value: instantly identifying a song a user hears, so success should track recognition usage and accuracy, not generic engagement.
- Propose a north star metric such as successful identifications per active user per week.
- Add supporting metrics: recognition accuracy rate, time to identify, and conversion from identification to a follow-on action like adding to a playlist or streaming.
- Add retention metrics: weekly active users and repeat usage rate, since Shazam is often a low-frequency, high-utility app.
- Add guardrail metrics: false-positive identification rate and app crash or latency rate, since a bad recognition breaks trust immediately.
- Segment by context, such as identifications made in noisy environments (bars, concerts) versus quiet ones, since accuracy will vary.
What a strong answer includes
- Chooses successful identifications, not raw app opens, as the north star, since Shazam's entire value is captured in that one action.
- Ties monetization and platform health together by tracking conversion to streaming (illustrative, such as 30 percent of identifications leading to a stream), which is how Shazam justifies its Apple Music integration.
- Treats accuracy and latency as guardrails, not vanity metrics, since a slow or wrong result destroys the core promise.
- Segments by use context (loud venue versus quiet room) to catch where accuracy actually breaks down.
Common mistakes
- Defaulting to generic app metrics like DAU or session length that do not reflect Shazam's single-purpose use case.
- Ignoring accuracy and latency as core guardrails, not secondary concerns.
Likely follow-up questions
- How would you detect that recognition accuracy is degrading before users start complaining?
- How would you weigh a feature that increases session length but does not increase successful identifications?
More metrics questions
- How do you define success for Yelp reviews?Google · Metrics · Medium
- Utilization went down by 45% on app XYZ in Italy for the month of August. Give a reason why and draft a plan to fix it.Spotify · Metrics · Medium
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You walk in to your office and find that Google cloud subscription has gone down by 20%. What do you do as a product manager?Google · Metrics · Medium
- What would be the top six metrics for WhatsApp? Now pick one from the six. Tell me three things you would do to improve that metric.Google · Metrics · Medium
More questions from these companies
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop