AI & Technical question
A banking or consulting client wants Harvey to automate a high-stakes workflow where user intent is ambiguous, source data is incomplete, and mistakes are costly. How would you decompose the workflow, decide which steps can be fully agentic versus human-in-the-loop, and define the evals, guardrails, and launch criteria needed to judge technical viability?
- Harvey
- AI & Technical
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
The answer guide for this question is on its way. You can still practice it now.
More ai & technical questions
- How would you prevent and handle hallucinated case law in Harvey's answers?Harvey · AI & Technical · Hard
- How would you measure the accuracy of Harvey's legal research outputs?Harvey · AI & Technical · Hard
- Vault’s architecture must balance fine-grained document permissions, fast search latency, fresh indexes, and AI workflows over sensitive data. As the PM, how would you define the product requirements, decision criteria, and tradeoffs for this architecture with engineering, and where would you draw the line between PM ownership and engineering ownership?Harvey · AI & Technical · Hard
- Suppose Harvey is building an Outlook or Word integration that drafts grounded work product from matter documents and email history. How would you partner with engineering to make architecture tradeoffs among retrieval depth vs latency, precomputed vs on-demand indexing, model quality vs cost, and strict permissioning vs implementation speed? What would you ship first, and why?Harvey · AI & Technical · Hard
- Harvey can integrate Vault with iManage, SharePoint, Box, and Dropbox, but engineering capacity is limited and each system differs in APIs, authentication, sync models, and permission semantics. How would you prioritize the integrations roadmap, define what is 'good enough' for v1, and make tradeoffs between speed, reliability, permissions fidelity, and user experience?Harvey · AI & Technical · Hard
- Design the first version of Harvey’s cross-system legal research experience for an enterprise customer using systems like iManage, SharePoint, and internal knowledge bases. Which user workflow would you support first, and how would you handle permissions, source freshness, citations or provenance, and failure modes so legal professionals trust the output?Harvey · AI & Technical · Hard
More questions from Harvey
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 1: Foundations: the model and the decisions it forces on you
- Chapter 8: Evals: define good and make the number defensible
- Chapter 6: Agents and agentic architecture