Netflix · Metrics · Senior · 60 to 90 minutes

Health Scorecard for Netflix Ads Plan

Netflix is a subscription streaming service that offers series, films, games, and some live programming, with both ad-free and ad-supported plans in selected countries. Answer this product management case and get it graded line by line against a weighted rubric.

Metric design
Strategic judgment
Tradeoff analysis
Executive alignment
Segmentation

The situation

You are a senior PM at Netflix working with the team that oversees the ad-supported plan. Leadership is preparing for the next planning cycle, and there is no single health view that everyone trusts. Product reviews focus on viewing, retention, and member satisfaction. Ads sales and operations focus on reach, fill rate, and revenue. Finance is asking whether the lower priced ad-supported plan is creating incremental profit or mainly shifting members out of higher priced ad-free plans. Your GM and the ads leadership team want one scorecard that can be used in weekly operating reviews and quarterly business reviews. Assume the following numbers are illustrative: in a major ad market, ad plan signups are up, ad revenue per member is improving, but hours viewed per member and satisfaction are slightly down, and plan migration between ad-supported and ad-free tiers is volatile. The hard part is choosing metrics that drive the right behavior. Push too hard on monetization and you risk ad overload, weaker retention, and lower long term trust. Push too hard on member metrics and advertisers may not get reliable reach, frequency control, and campaign delivery.

What to produce

A 1 to 2 page scorecard memo.

Your answer must

Define the scorecard objective and explicitly state the three stakeholder lenses it must balance, members, advertisers, and Netflix's business.
Propose a metric hierarchy with 1 north star, 4 to 8 core health metrics, and at least 3 guardrail metrics, with a one line definition for each.
Explain how the scorecard should be segmented, and name the launch cuts you would require, such as by market, acquisition cohort, new versus migrated members, and viewing or ad load intensity.
Include both leading and lagging indicators, and specify the review cadence for each metric, weekly, monthly, or quarterly.
Call out at least 3 failure modes or incentive traps, such as cannibalization, ad overload, low quality reach, or content mix distortion, and show which metrics would catch them.
Recommend example decision thresholds or intervention rules that leadership could use, even if the exact numbers are illustrative.

Constraints

You have 4 weeks, one data scientist, and existing dashboards and event logs, no large new measurement build before the next planning review.
Use metrics Netflix can observe directly or estimate with current first party systems in ad-supported plan markets, do not assume new third party panels or new device integrations.
The scorecard must work across multiple countries where the ad-supported plan exists, but leadership wants an initial version that can roll up globally and drill into the US.
Plan pricing and the near term content slate are fixed for the next two quarters, so focus on measurement and operating decisions, not repricing or content strategy changes.

Format

Start with the objective and metric philosophy, then show the scorecard hierarchy. Close with segmentation, cadence, thresholds, and risks.