Metrics question
How would you measure the success of Walmart+?
- Metrics
- Medium
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Tests defining success metrics for a membership program that bundles delivery, fuel discounts and other perks.
How to approach it
- Clarify the goal: Walmart+ should drive subscriber retention and higher basket size across Walmart's ecosystem, not just delivery volume.
- Set the north star as subscriber retention or renewal rate at the annual or monthly mark.
- Build supporting metrics: orders per member per month, average basket size for members versus non-members, and perk usage, fuel discount and free shipping.
- Add a guardrail on delivery cost per order, since free shipping has a real fulfillment cost that must stay below the membership fee's value.
- Segment by member tenure, since new members trialing the service behave differently from long-term renewers.
What a strong answer includes
- Picks retention as the true north star instead of vanity signups, since Walmart+ competes directly with Amazon Prime's stickiness.
- Ties member basket size to non-member basket size as a clear incremental-value comparison.
- Names delivery cost per order as a concrete guardrail against an unprofitable perk.
Common mistakes
- Measuring only total signups without tracking renewal or churn.
- Ignoring the real fulfillment cost of free delivery against the membership fee.
Likely follow-up questions
- How would you measure incremental spend caused by membership versus normal customer behavior?
- What would make you add or cut a perk like fuel discounts?
More metrics questions
- How would you measure the success of Facebook Likes?Meta · Metrics · Medium
- Walmart's order return rate is increasing. As a product manager, what things would you look into to isolate the problem?Amazon · Metrics · Medium
- What metrics would you track if you were PM of Facebook Birthdays?Metrics · Medium
- How do you define success for Yelp reviews?Google · Metrics · Medium
- Utilization went down by 45% on app XYZ in Italy for the month of August. Give a reason why and draft a plan to fix it.Spotify · Metrics · Medium
- Define the metrics for YouTube search.Google · Metrics · Medium
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop