Metrics question

How would you measure success for Facebook Rooms?

Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.

What this question tests

Metrics design for an ephemeral, casual social product where standard engagement metrics may mislead.

Clarify the product's core value: spontaneous, low friction video hangouts with friends, unlike scheduled video calls.
Define the north star metric: weekly active rooms created with at least two participants joining.
Add secondary metrics: average session length and repeat room creation rate within the same friend group.
Set a guardrail: ensure rooms aren't created but abandoned quickly, since that signals discoverability without real value.
Segment by friend group size, since larger groups may show different engagement patterns than pairs.
Define success over a multi week window, not a single launch spike, since novelty effects fade fast for social features.

Picks a specific north star, active rooms with real joins, rather than a vague 'usage' metric.
Adds a guardrail against hollow adoption, like rooms created but abandoned within a minute.
Proposes tracking repeat usage within the same friend group as a signal of genuine, not novelty-driven, value.
Explicitly frames success over weeks, acknowledging that casual social features often see a launch spike followed by decay.

Using total room creations alone without checking if anyone actually joined.
Judging success from a short initial spike without checking for sustained repeat usage.

Chapters of the AI PM course that teach what this question tests.