Metrics question
Harvey is considering expanding its platform to additional regions. How would you decide whether multi-region expansion is the right product investment now versus later? Explain the customer signals, business considerations, and success metrics you would use, and how you would compare this investment against competing platform priorities.
- Harvey
- Metrics
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Tests weighing a major infrastructure investment, multi-region expansion, against competing priorities using customer signals, business considerations, and success metrics.
How to approach it
- Gather customer signals precisely: how many deals are blocked or at risk specifically due to region, data residency, or latency requirements versus general interest.
- Weigh business considerations: cost of multi-region infrastructure and ongoing operational complexity against the revenue at stake from blocked deals.
- Set success metrics upfront: number of previously blocked deals closed, and latency improvement for existing customers in the target region.
- Compare this investment against other competing platform priorities using the same expected-value lens, revenue unblocked or protected per engineering quarter spent.
- Recommend timing based on the comparison, now if blocked-deal value clearly exceeds other roadmap items' expected value, later if not.
- Define a checkpoint after expansion to confirm the predicted deals actually closed, validating the investment thesis.
What a strong answer includes
- Uses blocked-deal count and value, not general interest, as the real customer signal for timing this investment.
- Compares multi-region expansion against other roadmap items using the same expected-value framework, not in isolation.
- Sets a post-launch checkpoint to confirm predicted deals actually closed, closing the loop on the original business case.
Common mistakes
- Treating general customer interest as equivalent to blocked-deal evidence.
- Evaluating the investment in isolation without comparing it to other roadmap priorities.
Likely follow-up questions
- How would you estimate the ongoing operational cost of a new region before committing?
- What would you do if expansion shipped but the predicted deals did not close?
More metrics questions
- What metrics prove Harvey's value to a firm like PwC or Paul Weiss?Harvey · Metrics · Hard
- What KPI hierarchy would you use for Vault, from account-level adoption and active matters to search success, document coverage, and workflow outcomes, to measure value for law firms and enterprises? How would those metrics change your roadmap if usage is high but repeat usage in critical workflows is low?Harvey · Metrics · Hard
- What metrics would you define for Command Center across adoption, admin efficiency, and governance coverage, and how would you use those metrics to decide whether the product is actually improving Harvey’s enterprise land-and-expand motion?Harvey · Metrics · Hard
- For Vault’s search and Q&A experience, what metrics would you define for adoption, engagement, trust, and business value at the workspace and firm level? Which leading indicators would you watch in the first 90 days, and how would changes in those metrics alter your product decisions?Harvey · Metrics · Hard
- A pilot agent deployment has strong qualitative feedback from senior stakeholders, but end-user adoption is inconsistent and the customer’s data environment is messy. How would you structure the deployment plan, define the success metrics, diagnose whether the issue is workflow fit vs data readiness vs change management, and decide if this should graduate into a repeatable product for the broader vertical?Harvey · Metrics · Hard
- If you joined Harvey, what 2 or 3 AI-assisted workflows would you implement first for the product communications team, and why those first? For each workflow, explain the job to be done, the human review points, the main failure modes or brand risks, and the metrics you would use to decide whether it improved speed or quality enough to scale.Harvey · Metrics · Hard
More questions from Harvey
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Measuring AI Product Economics
- Chapter 2: Using SQL and Logs
- Chapter 14: Interviewing for AI PM Roles