Metrics question
You have one team and can materially advance only one of these areas in the next 6-12 months: Skills, collaboration, artifact generation, or Projects. How would you choose where to invest, and what leading indicators and longer-term outcome metrics would you use to defend that roadmap to leadership?
- Perplexity
- Metrics
- Hard
Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.
Start a mock interview on this question · Mock interview from a job description
What this question tests
Tests making a hard single-bet resource allocation call across four plausible product areas, and defending it with both leading indicators and longer-term outcomes.
How to approach it
- Define the goal each area would serve: Skills for repeatable task automation, collaboration for multi-user work, artifact generation for output quality, Projects for ongoing structured work.
- Assess current signal for each: usage frequency, retention after first use, and qualitative feedback on what's most blocking further adoption today.
- Weigh strategic differentiation: which area most separates the product from competitors doing similar AI work, since that compounds over time.
- Pick one, for example Projects, if it's the structural layer that makes Skills, artifacts, and collaboration all more valuable once users have a persistent workspace to anchor them in.
- Define leading indicators to defend the bet: weekly active Projects, tasks completed within a Project, and time-to-value for a new Project.
- Define longer-term outcome metrics: retention lift for Project users versus non-Project users, and expansion of usage into new use cases over two to three quarters.
What a strong answer includes
- Picks one area explicitly and explains why it's structurally leveraged, for example Projects making the other three areas more valuable, rather than hedging across all four.
- Names concrete leading indicators, weekly active Projects and time-to-value, that would show early signal within weeks.
- Names a longer-term outcome metric, retention lift versus non-users, that would prove the bet mattered after months.
- Acknowledges the opportunity cost explicitly, naming what gets deprioritized and why that's an acceptable tradeoff.
Common mistakes
- Hedging by trying to advance all four areas a little instead of committing to one.
- Picking the area with the most current buzz rather than the one with the best evidence or leverage.
- Giving only lagging metrics with no leading indicator to know if the bet is working within the quarter.
Likely follow-up questions
- What evidence in month one would make you abandon this bet?
- How would you defend this choice to a team that wanted a different area?
More metrics questions
- What metrics would tell you whether Perplexity is winning against Google Search?Perplexity · Metrics · Hard
- Queries per user dropped 20% after a UI change. How do you investigate?Perplexity · Metrics · Medium
- Users can create Skills in Computer, but many run a Skill once and never use it again. How would you determine whether the main issue is setup friction, weak discoverability, inconsistent results, narrow applicability, or lack of trust, and what product changes would you test first to improve repeat use and sharing?Perplexity · Metrics · Hard
- Suppose Perplexity launches a new 'resume previous work' feature for research and productivity workflows. What metrics would you use to determine whether it improves retention, and how would you separate durable user value from short-term engagement spikes caused by novelty or accidental usage?Perplexity · Metrics · Hard
- Pick one Perplexity use case, research, investing, or shopping, and design a first prototype in Computer for a domain expert. What exact job-to-be-done would it solve, what would the user see and control step by step, and which early metrics would tell you the prototype is genuinely improving productivity?Perplexity · Metrics · Medium
- Perplexity cares about product-led growth and data-driven flywheels. For a new AI productivity feature inside Search or Computer, what user actions would you optimize first to drive activation, retention, and learning effects, and how would you know the feature is creating a real flywheel rather than a one-time novelty spike?Perplexity · Metrics · Hard
More questions from Perplexity
Learn the skill behind it
Chapters of the AI PM course that teach what this question tests.
- Chapter 9: Prove it paid off: outcomes, economics, and pricing
- Chapter 2: Data fluency: SQL, logs, and reading the truth yourself
- Chapter 14: Get the job: the AI PM interview loop