Metrics question
How would you approach adding a new ecommerce feature "Shop" to a subscription model product?
- Shopify
- Metrics
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Tests metric-driven prioritization for a business-model-adjacent feature addition, adding transactional commerce to a recurring-revenue product.
How to approach it
- Clarify the goal: whether Shop is meant to add incremental revenue, increase subscriber retention, or both.
- Build the metric tree: adoption, subscribers who browse Shop; conversion, purchase rate; incremental revenue per subscriber; and impact on core subscription retention.
- Add guardrails: cannibalization of the subscription's core value prop, and the new support and fulfillment cost overhead.
- Pilot to a subset of subscribers, A/B against a control group to isolate Shop's effect on retention, not just direct Shop revenue.
- Define success as net incremental LTV, subscription retention lift plus Shop revenue, versus the operational cost added.
What a strong answer includes
- Frames this correctly as a business-model question, adding transactional and logistics complexity, not just a feature launch.
- Proposes measuring the net effect on subscription retention, the metric most likely to be overlooked.
- Separates adoption, conversion and retention impact into distinct, trackable layers.
Common mistakes
- Measuring only direct Shop revenue while ignoring fulfillment cost and retention impact on the core subscription.
- Treating this as a pure feature launch rather than a business-model shift.
Likely follow-up questions
- How would you decide whether to build fulfillment in-house or partner?
- What would make you kill this feature if retention dropped?
More metrics questions
- 70% of shoppers of an eCommerce site are reviewing the site's return policy page prior to shopping. What do you do?Shopify · Metrics · Medium
- One of the brands in the grocery category is not selling and has stocks left that are soon to expire. Specify all possible reasons for it and also suggest solutions for each of the reasons.Shopify · Metrics · Medium
- How would reduce cancellations for Uber?Shopify · Metrics · Medium
- How do you convert offline customers to omnichannel customers who transact online for retail stores?Shopify · Metrics · Hard
- New patients are not showing up for their first telehealth appointment. How would you solve this issue?Shopify · Metrics · Medium
- Orders cancellation increased by 15%. How do you diagnose the root cause?Shopify · Metrics · Medium
More questions from Shopify
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop