Metrics question
How do you define success for Yelp reviews?
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Tests defining success for a trust-and-quality-driven feature (reviews) where raw volume isn't the same as value, and understanding two-sided marketplace dynamics.
How to approach it
- Clarify whose success: the reviewer (contributor), the reader (searcher deciding where to eat), or the business (listed on Yelp); success likely needs all three.
- Define reader-side metrics: % of business page visits where a user reads reviews before taking an action (call, directions, reservation), and conversion rate after reading reviews.
- Define reviewer-side metrics: number of reviews per active reviewer, and review quality signals (length, photos attached, marked 'useful' by others).
- Define trust metrics: fake/fraudulent review detection rate, and business dispute rate, since Yelp's core value proposition is trustworthy reviews.
- Define business-side metrics: businesses reporting reviews drove real foot traffic or bookings, closing the loop on value delivered.
- Prioritize trust metrics as guardrails above volume metrics, since a flood of low-quality or fake reviews would increase volume but destroy the product's core value.
What a strong answer includes
- Frames success across three sides of the marketplace (reviewer, reader, business) instead of picking just one.
- Prioritizes trust and authenticity metrics as guardrails, correctly identifying that Yelp's business model depends on review credibility.
- Proposes a 'useful' vote or helpfulness signal as a quality proxy beyond raw review count.
- Connects reader engagement with reviews to a real downstream action (call, directions, reservation), tying metrics to actual value delivered.
Common mistakes
- Treating total review count as the sole success metric without any quality or trust dimension.
- Ignoring the business side of the marketplace, focusing only on consumers.
- No mention of fake review detection, a well-known real risk for Yelp specifically.
Likely follow-up questions
- How would you detect and handle fake or incentivized reviews?
- How would you weigh a highly detailed review versus ten one-line reviews?
- How would success metrics differ for a new business versus an established one?
More metrics questions
- Utilization went down by 45% on app XYZ in Italy for the month of August. Give a reason why and draft a plan to fix it.Spotify · Metrics · Medium
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Define the metrics for YouTube search.Google · Metrics · Medium
- You walk in to your office and find that Google cloud subscription has gone down by 20%. What do you do as a product manager?Google · Metrics · Medium
- What would be the top six metrics for WhatsApp? Now pick one from the six. Tell me three things you would do to improve that metric.Google · Metrics · Medium
- How do you measure the success of Google Search?Google · Metrics · Medium
More questions from these companies
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop