Metrics question

You launch a new app ecosystem surface in ChatGPT. What north-star, guardrail, and ecosystem-health metrics would you track across users, partners, and the platform? How would your metric set differ between consumer self-serve usage and enterprise deployments with admins and compliance requirements?

Practice this question out loud. An AI interviewer asks it, follows up like a real interviewer would, and scores your answer. Type or speak.

What this question tests

Whether you can define a layered metrics framework for a platform launch and adapt it for very different consumer and enterprise contexts.

Define north-star metrics: weekly active users engaging with third-party apps, and for partners, active integrations generating repeat usage.
Define guardrail metrics: safety and policy violation rate per app, user complaint rate, and app approval-to-incident ratio.
Define ecosystem-health metrics: partner retention, time from submission to approval, and distribution of usage across apps (to catch over-concentration risk).
For consumer self-serve, weight discovery and activation metrics higher, since the user journey is unassisted and low-friction.
For enterprise, add admin-specific metrics: percent of admins who configure app allowlists, compliance audit completion rate, and support ticket volume tied to governance.
Set guardrails tighter for enterprise given compliance requirements, for example a stricter safety-incident threshold before an app can be surfaced to enterprise users.

Separates north-star, guardrail, and ecosystem-health metrics into three distinct tiers rather than one flat list.
Adds enterprise-specific governance metrics (allowlist configuration, compliance completion) that a consumer metric set would miss entirely.
Names a concrete ecosystem-health risk, usage over-concentrated in a few apps, which threatens long-term platform diversity.
Explains why guardrail thresholds should differ by context, tying it to compliance stakes in enterprise deployments.

Using one identical metric set for both consumer and enterprise without adapting for admin and compliance needs.
No ecosystem-health metric, focusing only on user-side engagement.
Missing a concrete guardrail for safety or policy violations.

How would you detect an app becoming a systemic safety risk before it causes real harm?
What would make you delist or restrict a popular but risky app?
How would you balance ecosystem diversity against user preference for a few dominant apps?