Strategy question
How do you evaluate data vendors based on a decision tree model?
- Strategy
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Structured vendor evaluation, using a decision framework to weigh multiple criteria under uncertainty.
How to approach it
- Clarify what data vendor is being evaluated for, e.g. cost, data quality, coverage, or integration ease.
- Define the top level decision criteria, data accuracy, coverage breadth, cost per record, and integration or support quality.
- Build the decision tree, starting with a hard gate like minimum accuracy threshold, then branching into cost versus coverage tradeoffs.
- Weight each branch by business priority, e.g. accuracy weighted highest if the data feeds a customer-facing feature.
- Score each vendor against the tree and compare, using a pilot or sample dataset to validate accuracy claims before committing.
- Define a decision rule, e.g. select the vendor with the highest weighted score that also passes the minimum accuracy gate.
What a strong answer includes
- Uses a hard gate first, a minimum accuracy or compliance threshold, before optimizing on cost, avoiding a race to the cheapest vendor.
- Proposes validating vendor claims with a real sample dataset rather than trusting marketing claims alone.
- Explicitly weights criteria by business priority instead of treating all factors as equally important.
- Defines a clear decision rule at the end, not just a scoring exercise with no resolution.
Common mistakes
- Listing evaluation criteria without weighting them by importance.
- Trusting vendor-provided accuracy claims without independent validation.
- Not defining a clear decision rule to resolve the evaluation.
Likely follow-up questions
- How would you validate a vendor's accuracy claims independently.
- What would make you switch vendors after choosing one.
- How would you handle a tie between two vendors.
More strategy questions
- Google Keep is a free product to save, share notes etc. How would you make it a subscription product & monetize it?Google · Strategy · Hard
- How would you launch (roll out) Amazon Go?Amazon · Strategy · Hard
- With an unlimited network bandwidth what would you build?Google · Strategy · Hard
- Strategize and implement omni-channel initiatives to improve customer LTV for Walmart.Shopify · Strategy · Hard
- How would you decide between showing more ads on the Facebook Newsfeed vs showing a "People you may know" recommendation widget?Meta · Strategy · Hard
- Should Uber Eats be a different app from Uber Rides?Lyft · Strategy · Hard
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 4: Discovery and strategy for AI products
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 14: Get the job: the AI PM interview loop