AI & Technical question
Design the first version of Harvey’s cross-system legal research experience for an enterprise customer using systems like iManage, SharePoint, and internal knowledge bases. Which user workflow would you support first, and how would you handle permissions, source freshness, citations or provenance, and failure modes so legal professionals trust the output?
- Harvey
- AI & Technical
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Whether you can design a trustworthy enterprise legal research experience that handles permissions, freshness, and provenance correctly from day one.
How to approach it
- Pick the first workflow: due diligence or precedent research pulling from a specific matter's document set across iManage, SharePoint, and internal knowledge bases, since it is high-frequency and has clear, bounded scope.
- Design permissions as a hard constraint, not a feature: results must respect each source system's existing access controls, with no cross-matter leakage, verified before any content is surfaced.
- Handle source freshness by surfacing the retrieval date and flagging when a cited document may be outdated relative to the matter's current state.
- Require citations and provenance on every claim, showing the exact source document and location, since legal professionals will not trust or use ungrounded answers.
- Define failure modes explicitly: when permissions block a relevant document, tell the user a restricted result exists rather than silently omitting it or (worse) revealing its content.
- Pilot with a single practice group and a bounded document set to validate permission handling and citation accuracy before expanding to broader cross-system scope.
What a strong answer includes
- Picks a bounded first workflow instead of trying to cover all legal research use cases at once, showing real MVP judgment.
- Treats permissions as a precondition, not a feature to add later, appropriate for a legal product where data leakage has serious consequences.
- Requires citations and provenance as non-negotiable, directly matching how legal professionals evaluate trust in research output.
- Names the specific edge case of a permission-restricted but relevant document and proposes a safe way to acknowledge it without leaking content.
Common mistakes
- Treating permissions as an implementation detail rather than a core design constraint.
- No citation or provenance requirement, which legal professionals will reject immediately.
- Scoping too broadly across all systems and workflows at once instead of piloting narrowly first.
Likely follow-up questions
- How would you handle a document that exists in two systems with conflicting versions?
- What would you do if citation accuracy is high but permission enforcement has a false negative?
- How would you expand from the first practice group to the rest of the firm?
More ai & technical questions
- How would you prevent and handle hallucinated case law in Harvey's answers?Harvey · AI & Technical · Hard
- How would you measure the accuracy of Harvey's legal research outputs?Harvey · AI & Technical · Hard
- Vault’s architecture must balance fine-grained document permissions, fast search latency, fresh indexes, and AI workflows over sensitive data. As the PM, how would you define the product requirements, decision criteria, and tradeoffs for this architecture with engineering, and where would you draw the line between PM ownership and engineering ownership?Harvey · AI & Technical · Hard
- A banking or consulting client wants Harvey to automate a high-stakes workflow where user intent is ambiguous, source data is incomplete, and mistakes are costly. How would you decompose the workflow, decide which steps can be fully agentic versus human-in-the-loop, and define the evals, guardrails, and launch criteria needed to judge technical viability?Harvey · AI & Technical · Hard
- Suppose Harvey is building an Outlook or Word integration that drafts grounded work product from matter documents and email history. How would you partner with engineering to make architecture tradeoffs among retrieval depth vs latency, precomputed vs on-demand indexing, model quality vs cost, and strict permissioning vs implementation speed? What would you ship first, and why?Harvey · AI & Technical · Hard
- Harvey can integrate Vault with iManage, SharePoint, Box, and Dropbox, but engineering capacity is limited and each system differs in APIs, authentication, sync models, and permission semantics. How would you prioritize the integrations roadmap, define what is 'good enough' for v1, and make tradeoffs between speed, reliability, permissions fidelity, and user experience?Harvey · AI & Technical · Hard
More questions from Harvey
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 1: Foundations: the model and the decisions it forces on you
- Chapter 8: Evals: define good and make the number defensible
- Chapter 6: Agents and agentic architecture