Metrics question

How would you evaluate a product that you don't know much about? Imagine that it is not a Google product and you are not a power user.

Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.

What this question tests

Tests a general framework for product evaluation that doesn't rely on insider knowledge or personal familiarity with the product.

Start by clarifying the product's stated purpose and target user from its own marketing or app store description.
Use the product as a first-time user would, noting friction points in onboarding, the core action, and any moment of confusion or delight.
Check external signals: app store reviews and ratings, search for common complaints, and how it's positioned against known competitors.
Infer likely business metrics from public signals, like download rank, review volume trends, and how frequently it appears to release updates.
Form a structured opinion: strengths, weaknesses, and what one metric you'd want internal data on to actually validate your read of the product.

Builds a repeatable framework, stated purpose, hands-on use, external signals, rather than a one-off subjective take.
Uses accessible external proxies, reviews and competitor comparison, since real internal data isn't available.
Names the one metric that would most validate the assessment, showing awareness of what's unknown without insider data.

Giving a purely subjective opinion with no structured framework behind it.
Assuming access to internal metrics that a true outsider evaluating any product wouldn't actually have.

Chapters of the AI PM course that teach what this question tests.