Product design question
A top law firm is willing to pilot Vault, but attorneys are hesitant to move matter documents into a new system because of security concerns, ethical walls, permissions complexity, and workflow disruption. How would you diagnose the biggest adoption blockers, what evidence would you gather, and how would you prioritize the first product changes to improve rollout success?
- Harvey
- Product design
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Tests the ability to diagnose adoption blockers rooted in trust and workflow disruption, gathering real evidence before prioritizing product changes.
How to approach it
- Interview the hesitant attorneys directly to distinguish concerns about security policy, ethical walls, permissions complexity, or simple workflow disruption.
- Review whether the security concern is about Harvey's actual security posture or a perception gap, since the fix differs, technical hardening versus better communication.
- Check if ethical wall and permissions complexity concerns point to a real product gap, such as insufficiently granular permission controls.
- Gather evidence on workflow disruption specifically, for example how much extra step the migration adds to an attorney's existing document workflow.
- Prioritize fixes that address the most cited and highest severity blocker first, rather than spreading effort evenly across all concerns.
- Propose a low friction pilot, such as migrating one matter type first, to let skeptical attorneys build trust incrementally rather than all at once.
What a strong answer includes
- Separates a real security or permissions product gap from a perception or communication gap, since the fix is completely different for each.
- Gathers evidence directly from the hesitant attorneys rather than assuming what is blocking adoption from secondhand reports.
- Proposes an incremental pilot, one matter type first, as a concrete way to build trust rather than asking for full migration upfront.
Common mistakes
- Assuming the blocker is security without confirming whether it is a real gap or a perception issue.
- Prioritizing product changes evenly across all stated concerns instead of focusing on the most cited, highest severity one first.
Likely follow-up questions
- How would you measure whether the perception gap, if it is one, has actually closed after your changes?
- What would you do if the ethical wall concern points to a genuine permissions product gap that takes months to fix?
More product design questions
- How would you improve Harvey's Vault for bulk document review at large law firms?Harvey · Product design · Hard
- Design a citation system so lawyers can fully trust Harvey's outputs.Harvey · Product design · Hard
- Design a Workflow Builder that lets non-technical lawyers automate recurring tasks.Harvey · Product design · Medium
- A top law firm says Vault’s AI search is promising, but attorneys still avoid using it in high-stakes matters. How would you diagnose whether the trust gap comes from retrieval quality, citation and explanation UX, permissioning concerns, workflow fit, or change management, and how would you prioritize the first product changes?Harvey · Product design · Hard
- Several top law firm customers say they will not expand Harvey without stronger identity and access management. How would you prioritize and scope SSO, SCIM, RBAC, and audit logging for the first two releases of Command Center, and how would you balance enterprise security requirements against implementation complexity and admin usability?Harvey · Product design · Hard
- Lawyers will rarely ask for 'better queuing' or 'stronger isolation,' but they will care deeply about accuracy, latency, reliability, auditability, and security. How would you uncover those needs and translate them into clear infrastructure product requirements and prioritized engineering work? Be specific about discovery methods, requirement framing, and how you would separate must-haves from nice-to-haves.Harvey · Product design · Hard
More questions from Harvey
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 4: Discovery and strategy for AI products
- Chapter 7: AI UX and human oversight: design for a system that is wrong sometimes
- Chapter 14: Get the job: the AI PM interview loop