Metrics question
Wayfair has three shipping methods that they use to deliver products to customers. They are considering changing the shipping price of one of these methods. What is the impact of this change in price on profits?
- Wayfair
- Metrics
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Structured quantitative reasoning about a pricing change's effect on profit, considering volume elasticity, not just margin per order.
How to approach it
- Clarify which shipping method's price is changing and by how much, since the answer depends on these specifics; state an illustrative assumption, for example raising the price of the standard shipping method by 2 dollars.
- Identify the two opposing effects: higher shipping price increases margin per order that still ships via that method, but likely reduces the number of customers choosing it or ordering at all.
- Estimate a demand elasticity assumption, for example assuming a 2 dollar increase reduces orders using that method by 10 percent due to price sensitivity.
- Build a simple before and after comparison: baseline orders times old margin per order versus reduced orders times new, higher margin per order.
- Compare the two totals to see whether the margin gain per order outweighs the volume loss, and note this depends heavily on the elasticity assumption.
- Recommend testing the price change on a small segment first, since the actual elasticity is uncertain and the profit impact could go either way.
What a strong answer includes
- Structures the answer around the two competing forces, margin per order versus volume loss, rather than assuming price increases always help profit.
- Uses a labeled, illustrative elasticity assumption instead of ignoring demand response entirely.
- Shows the before and after comparison explicitly rather than asserting a conclusion without the math.
- Recommends a test based approach given real uncertainty in the elasticity assumption, showing good experimental instinct.
Common mistakes
- Assuming a price increase automatically increases profit without considering reduced order volume.
- Giving a purely qualitative answer with no attempt at even an illustrative calculation.
Likely follow-up questions
- How would you design an experiment to measure the actual elasticity before rolling this out broadly?
- How would this analysis change if competitors also offer free or cheaper shipping?
More metrics questions
- How would you measure the performance and health of a Netflix Original?Microsoft · Metrics · Hard
- Imagine you are the PM in charge of Reactions on Facebook - the new way to interact with posts by using “love”, “haha”, “wow”, “sad”, and “angry” reactions. What would success look like in terms of number of non-like reactions per post at launch and how do you come up with this? Would this number differ by reaction? Why or why not?Meta · Metrics · Hard
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?Google · Metrics · Hard
- Facebook Ads dropped by 20%. Mark Zuckerberg calls you and asks you to fix it. What do you do?Meta · Metrics · Hard
- Imagine you're the product manager for Facebook Marketplace. Since many sellers don't mark items as sold, what existing functionality and metrics could you use to determine whether an item has likely sold?Meta · Metrics · Hard
- Uber has seen a dip in the ride confirmation rate. As a PM at Uber, you are responsible to investigate and fix the issue. How will you go about it?Uber · Metrics · Hard
More questions from Wayfair
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop