Metrics question

You have three early Labs concepts competing for the same research and engineering team. How would you rank them, and how would your evidence standard change from concept memo to prototype to limited release to full launch?

Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.

What this question tests

Tests prioritization across competing early-stage bets and defining how much evidence should be required at each stage of maturity.

Score the three concepts on a common framework: potential user value, technical feasibility with current models, and strategic fit.
Weigh team fit too, since the same research and engineering team can't serve all three equally well.
Rank by expected value per unit of scarce team time, not by which concept is most exciting on its own.
Define an evidence standard that escalates by stage: a memo needs a plausible use case, a prototype needs a working demo, limited release needs real user data.
Revisit the ranking as each concept clears or fails its stage-appropriate bar, rather than committing to one winner upfront.

Names a concrete scoring dimension set, value, feasibility, and strategic fit, rather than a vague gut ranking.
Explicitly ties evidence requirements to stage, such as a memo only needing a hypothesis while limited release needs retention data.
Shows willingness to re-rank as evidence comes in rather than anchoring to the initial pick.
Addresses the shared-team constraint directly, since resourcing one concept starves the others.

Ranking based on which concept is most technically impressive rather than expected user value.
Using the same evidence bar at every stage instead of raising it as investment increases.

Chapters of the AI PM course that teach what this question tests.