Metrics question

You were recently hired as a product manager for an education portal. Its website has courses that people can take, for example, Python programming. Your product is close to launching. What metrics are you interested in tracking and preparing for and why?

Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.

What this question tests

Whether you can pick metrics tied to a pre-launch product's actual success definition, not just generic web analytics.

Clarify the launch goal: is success learner completion, paid conversion, or content quality signal at this early stage.
Build a funnel for a course like Python programming: landing page view, enrollment, lesson completion, course completion.
Track engagement depth, not just signups: percent of enrolled learners completing lesson 1, and median lessons completed per learner.
Add quality signals: average quiz score and learner ratings, since a course with high signups but low completion signals a content problem.
Track business metrics if monetized: conversion to paid, refund rate, and cost per enrolled learner from marketing.
Prioritize completion rate and quiz performance pre-launch, since those validate the content actually works before scaling acquisition.

Distinguishes top-of-funnel metrics like signups from depth metrics like completion, prioritizing the latter pre-launch.
Adds a quality signal, quiz score or rating, to catch a content problem that raw completion alone would miss.
Gives an illustrative benchmark, assuming a healthy course completion rate is around 20 to 30 percent for a first cohort.
Ties business metrics, like refund rate, to product quality rather than tracking them in isolation.

Only tracking signups and traffic, ignoring whether learners actually complete and learn.
Picking metrics generic to any website instead of ones specific to course-based learning.

Chapters of the AI PM course that teach what this question tests.