All Things PM
Lean Analytics
Discovery

Lean Analytics

Alistair Croll and Benjamin Yoskovitz · 30 min read

A field guide to the one number worth obsessing over right now, built on a simple engine: your business model plus your growth stage tells you the single metric to move, and a "line in the sand" tells you when you have moved it enough.

Key ideas

  • The metric worth obsessing over right now is the One Metric That Matters: the single number tied to your riskiest assumption at your current stage, chosen so the whole team pulls in one direction.
  • A good metric is a rate or ratio, is comparable across time or segments, is simple enough to remember, and changes what you do; a number that only ever goes up and never changes a decision is a vanity metric.
  • Which number matters is set by two things at once: which of six business models you are, and which of five growth stages you are in.
  • Growth is gated. You do not chase virality or revenue until people actually come back, and you do not scale until a dollar in reliably produces more than a dollar out.
  • Decide your line in the sand before you measure: name the number that would count as success in advance, so data settles a question instead of decorating a decision you already made.
  • Data informs judgment, it does not replace it. Numbers surface the question worth answering; an experiment answers it; a human still decides what to do about the answer.

The one metric that matters is the number you would bet the company on this month, and naming it out loud is what stops a team from hiding inside a dashboard of numbers that only ever go up.

Mental models

  • The One Metric That Matters (OMTM) — The single number a team agrees to focus on for a given period, chosen because it maps to the current riskiest part of the business. It forces a clear question, draws a line in the sand for success, focuses the whole company, and encourages a culture of experiment. It is deliberately temporary: as the risk moves, the OMTM moves.
  • The good-metric test — A number earns its place only if it is comparative (this week versus last, this cohort versus that one), understandable (people can remember it and talk about it), a ratio or rate rather than a running total (rates are actionable and inherently comparative), and behavior-changing (a different reading would make you do something different). Fail any of these and it is probably a vanity metric.
  • Model times Stage equals your metric — The whole book runs on one engine. There are six common business models (e-commerce, SaaS, free mobile app, media site, user-generated content, two-sided marketplace) and five stages of growth (Empathy, Stickiness, Virality, Revenue, Scale). Where your model and your stage intersect tells you which metric is your OMTM right now.
  • The five growth stages as gates — Empathy (is this a real problem worth solving), Stickiness (can we build something people use and return to), Virality (does usage spread), Revenue (does the money math work), Scale (can we grow it past ourselves). Each stage has an exit condition; skipping one, for example buying growth before the product is sticky, wastes the users you buy.

Product applications

  • Pick one OMTM for your team this quarter tied to your single biggest risk, put it where everyone sees it, and stop reporting the other twenty numbers in standup so the team actually rallies behind moving one thing.
  • Before an experiment, write the line in the sand out loud: "we ship if activation beats X percent." That turns the launch review into a yes or no instead of an argument about whether the number "feels" good enough.
  • Audit your current KPIs against the good-metric test and retire any vanity metric, total registered users, cumulative downloads, all-time pageviews, that only climbs and never once changed a decision you made.
  • Diagnose your product's real stage honestly. If retention is weak, freeze acquisition and growth work and fix stickiness first, because pouring paid users into a leaky bucket wastes every one of them.
  • Never report a metric bare. Pair it with a segment and a benchmark, this cohort versus last, or your rate against the industry line, so the team can tell whether the number is actually good or just large.

Questions to think about

If you could track only one number for your product for the next sixty days, which would it be, and does your honest answer reveal that you are measuring the stage you wish you were at rather than the stage you are actually at?

Chapter by chapter

Chapter 1

We're All Liars

Founders and product people lie to themselves constantly, not out of dishonesty but out of the optimism that makes anyone start something hard in the first place. You fall in love with your idea, then unconsciously collect the evidence that flatters it and wave away the evidence that does not.

Analytics exists to counteract that built-in bias. Its real job is not to generate reports; it is to be the cold outside voice that tells you the truth your own enthusiasm is hiding from you, before you spend a year building the wrong thing.

The Airbnb story is the load-bearing example. Early listings were not converting, and the gut instinct would have been to tweak pricing or copy. Instead the founders noticed the photos were terrible, rented a camera, shot professional listing photos by hand, and revenue roughly doubled. A guess, tested cheaply against reality, beat a plausible assumption.

For a PM, the lesson is to treat your own conviction as a hypothesis, not a conclusion. The moment you catch yourself explaining away a bad number, that number is probably the most important one on your dashboard, and the discomfort is the signal to go look, not to look away.

Chapter 2

How to Keep Score

Not every number deserves your attention, and most of the ones teams track are actively misleading. The chapter sorts metrics along several axes so you can tell a useful number from a comforting one.

Four ways to sort a metric

  • Quantitative versus qualitative: numbers tell you what and how much; interviews and observation tell you why. You need both, and early on the why matters more.
  • Vanity versus actionable: a vanity metric makes you feel good but never changes a decision (total signups only ever rises); an actionable metric ties to a choice you would actually make differently.
  • Exploratory versus reporting: exploratory metrics hunt for the unknown insight that gives you an edge; reporting metrics confirm you are still running normally.
  • Leading versus lagging: a leading metric predicts the future (new sales-qualified leads), a lagging one records the past (last quarter's revenue). Leading indicators let you steer before it is too late.

The sharpest single test is correlation versus causation. Two metrics that move together are only useful once you have run an experiment to prove one actually drives the other. Acting on a correlation you have not tested is how teams "optimize" a number that turns out to change nothing.

The PM takeaway: before you put a metric on a roadmap goal, ask which of these it is. A lagging vanity metric like cumulative downloads has no business steering a decision, no matter how good the chart looks in a board deck.

Chapter 3

Deciding What to Do with Your Life

A metric only means something against a target you set in advance. The core device of the whole book appears here: the "line in the sand." Before you run a test or read a number, decide what result would count as good enough to keep going, and what result would mean stop.

Without a line drawn first, any number can be rationalized after the fact. A 3 percent conversion rate is a triumph or a disaster depending entirely on what you decided beforehand you needed, and deciding after you see the number is just moving the goalposts to protect the idea.

A good line in the sand does three things. It converts a vague hope ("people will love this") into a falsifiable claim ("at least 30 percent of trial users will return in week two"). It forces honesty, because you committed to the threshold before you had a reason to bend it. And it turns a review meeting into a decision instead of a debate.

For product work, this reframes experiment design. The hard part is not building the test; it is agreeing, with your team and stakeholders, on the number that would change your mind, and writing it down where everyone can see it before the results land.

Chapter 4

Data-Driven Versus Data-Informed

Being purely "data-driven" sounds rigorous but quietly hands the steering wheel to a spreadsheet. Data is very good at optimizing within a known model and very bad at telling you to change the model entirely. Follow it blindly and you can hill-climb your way to a local peak while the real opportunity sits on a different mountain.

The alternative is data-informed: use numbers to find the questions worth asking and to check your instincts, but keep a human in the loop who can make the leaps data never suggests on its own. Data optimizes; judgment invents.

The distinction matters most at the edges of a product. Optimization tests will happily tune a checkout flow, but no A/B test would ever have told Netflix to abandon DVDs for streaming. That kind of move comes from judgment about where the world is going, informed by data rather than dictated by it.

The PM lesson is to know which mode a decision calls for. Reserve data-driven rigor for optimizing something that already works, and reserve data-informed judgment for the bigger bets where the numbers can only advise, never decide.

Chapter 5

Analytics Frameworks

Raw metrics are noise until a framework organizes them into a story of how your business actually works. Several well-known lenses each capture part of that story, and the point is to borrow the structure that fits your model rather than adopt one on faith.

Frameworks worth stealing from

  • Dave McClure's Pirate Metrics (AARRR): Acquisition, Activation, Retention, Referral, Revenue, the five stages a user moves through, each a place to measure and improve.
  • Eric Ries's engines of growth: sticky (retention driven), viral (spread driven), and paid (spend driven), each with a different core metric to watch.
  • Ash Maurya's Lean Canvas: a one-page model of the whole business that shows which assumptions are riskiest and therefore worth measuring first.
  • The long funnel: tracking a user backward from a goal all the way to the original source, so you can see which channels produce customers, not just clicks.

Croll and Yoskovitz fold these into their own Lean Analytics Cycle: find the riskiest assumption, find the metric that tests it, draw a line in the sand, run an experiment, learn, and repeat. It is the scientific method wearing a startup jersey.

For a PM, the practical move is to map your product onto one funnel explicitly, then ask which single stage is leaking worst. That leak, not the stage that is easiest to influence, is where a framework earns its keep.

Chapter 6

The Discipline of the One Metric That Matters

This is the spine of the book. At any moment a business has one part that is riskiest, and the One Metric That Matters is the number that tracks that risk. Focusing on it is a discipline precisely because there are always a dozen other numbers begging for attention.

Why one number, and what it buys you

  • It answers the most important question you have right now, and ignores the ones that can wait.
  • It forces a line in the sand, a specific target and deadline, so success is defined before you start.
  • It focuses the entire company on one goal, which is worth more than marginal progress on five.
  • It encourages a culture of experiment, because a single shared number makes it obvious whether a test moved the needle.

The OMTM is explicitly temporary. Once you have moved it past its line, the riskiest part of the business shifts, and your one metric should shift with it. A team still optimizing last quarter's OMTM is optimizing a risk it already retired.

For product teams this is a permission slip to say no. When a stakeholder asks why you are not also chasing five other numbers, the OMTM is your answer: those numbers are real, but they are not what is most likely to kill us this month, so they wait.

Chapter 7

What Business Are You In?

The metric that matters depends first on what kind of business you run, and most companies are a recognizable version of one of six models. Naming yours is not academic; it tells you which numbers are life-or-death and which are noise.

Every model is really a set of relationships between a few core levers. The book frames them along shared dimensions: how you make money (transaction, subscription, advertising, or a cut of others' trades), how much engagement you need, how you acquire users, and how virality and pricing interact.

The six models are e-commerce, software as a service, free mobile app, media site, user-generated content, and two-sided marketplace. The next six chapters take each in turn, but the meta-point is that a SaaS company and a media site can look similar on a dashboard while being driven by completely different economics.

For a PM, this is a prompt to stop importing another company's north-star metric because it sounds impressive. A media site chasing a SaaS churn number, or a marketplace obsessing over a media site's pageviews, is measuring someone else's business.

Chapter 8

Model One: E-commerce

An e-commerce business sells things, so its economics live in a short chain: get visitors, convert them to buyers, get them to buy again, and make each purchase worth more than it cost to win. The headline number is conversion rate, but it is far from the only one that matters.

The numbers that actually run the shop

  • Conversion rate: share of visitors who buy, the classic top-line efficiency measure.
  • Purchases per year and repeat purchase rate: whether you are a loyalty business or an acquisition business (more on this in the benchmarks chapter).
  • Average order value and shopping cart abandonment: how much each buyer spends, and how many you lose at the finish line.
  • Customer acquisition cost and lifetime value: the two numbers whose ratio decides whether the whole model is even viable.

A crucial insight is that "conversion rate" is meaningless without knowing whether you win on repeat buyers or new ones. A business where most revenue comes from loyal repeat customers should invest in retention and email; one that lives on new buyers should pour effort into acquisition and search.

The PM takeaway is to segment before optimizing. Lifting overall conversion by 0.5 percent sounds good until you learn the gain came entirely from existing loyalists, while the new-visitor funnel, the part you actually needed to fix, did not move at all.

Chapter 9

Model Two: Software as a Service (SaaS)

A SaaS business rents software by the month, so its whole life is a race between adding recurring revenue and losing it to churn. Unlike e-commerce, a customer's value arrives slowly over many months, which makes retention the number that quietly decides everything.

The levers of a subscription

  • Churn: the percentage of customers (or revenue) you lose each month, the single most dangerous number in the model.
  • Free-to-paid conversion: for freemium or free-trial products, how many samplers become payers.
  • Monthly recurring revenue and its growth, plus upsell and expansion revenue from existing accounts.
  • Customer lifetime value versus acquisition cost, where LTV is heavily governed by how long people stay.

Churn compounds cruelly. A few percent lost every month caps how large you can ever get, because at some point you are refilling a bucket as fast as you can pour, and every new customer just replaces a lost one instead of adding to the total.

For product teams, the lesson is that in SaaS, retention and engagement work is not a "nice to have" behind growth features; it is growth. The most valuable roadmap item is often the one that gets a wavering account to stay, because a saved customer keeps paying for years.

Chapter 10

Model Three: Free Mobile App

A free app makes almost all its money from a tiny slice of users, so the model is really about the gap between the many who play free and the few who pay. Downloads are a vanity number; what matters is what happens after install.

Where free-app money actually comes from

  • Download-to-launch and daily and monthly active users: how many installs turn into real, recurring use.
  • Percentage of active users who pay: usually very small, so its exact size and how you grow it dominate revenue.
  • Average revenue per user and per paying user: the yardsticks for whether monetization is working.
  • Retention and virality: because paid acquisition rarely pays back, the model leans hard on users staying and inviting others.

The economics are brutal for a reason: app store discovery is crowded and paid installs are expensive, so a free app usually cannot buy its way to profit. It survives only if retained users invite friends and a small paying core funds everyone else.

For a PM, this means treating the first session and the invite loop as the product, not features around it. If a new user does not reach the "aha" moment fast and have an easy reason to bring someone along, no amount of downloads will save the numbers.

Chapter 11

Model Four: Media Site

A media site sells attention to advertisers, so its currency is engaged eyeballs and its risk is that it must keep two very different customers happy at once: readers who want content and advertisers who want those readers.

Balancing readers against advertisers

  • Audience and engagement: visitors, pages per visit, time on site, and how often people come back.
  • Ad inventory and fill rate: how many ad slots you have and how many actually sell.
  • Click-through and revenue per thousand impressions: how well the ads that do run turn attention into money.
  • Content freshness: since traffic decays, the rate at which you produce material people want.

The built-in tension defines the model. More ads raise short-term revenue but degrade the reading experience, which erodes the audience the ads depend on. A media business is always managing that trade-off, not solving it once.

For product people, the lesson is to watch the leading indicator, engagement, more closely than the lagging one, ad revenue. When time on site and return visits slip, ad income will follow a quarter later, so the audience metric is the early warning the revenue chart cannot give you.

Chapter 12

Model Five: User-Generated Content

A user-generated content business, a forum, a social network, a review site, produces almost nothing itself; its users make the value. The core risk is engagement: without a steady flow of contributions the whole thing is an empty room.

The engagement funnel, not the sales funnel

  • The ladder of participation: visitors, who become registered users, who become active users, who become creators of content.
  • The share of users who actually contribute versus lurk, which is usually small and which the whole model depends on lifting.
  • Frequency and depth of visits: how often people return and how much they do when they arrive.
  • The fraction of content that is good rather than spam, since quality is what keeps the audience coming.

The famous shape here is the "1 percent rule": in many communities a tiny minority create, a slightly larger group react, and the vast majority only consume. The model works by moving people up that ladder, not by treating all users as the same.

For a PM, the takeaway is to measure the engagement funnel as carefully as an e-commerce team measures the purchase funnel. The metric that matters is the conversion from passive lurker to active creator, because every rung up that ladder is worth more than another anonymous visit.

Chapter 13

Model Six: Two-Sided Marketplaces

A marketplace connects buyers and sellers and takes a cut, which makes it the hardest model to start because you must grow two populations at once. Neither side shows up for an empty market, which is the classic chicken-and-egg problem.

Growing both sides without tipping over

  • Buyer and seller growth, tracked separately, because the two rarely grow at the same rate.
  • Liquidity: the odds that a listing actually sells or a search actually finds something, the real measure of a working market.
  • Transaction volume and take rate: how much trade flows through and what slice you keep.
  • Search-to-fill and inventory: whether supply exists to satisfy the demand you are attracting.

The standard advice is to solve the harder side first, usually supply, often by hand and in a narrow niche, then use that supply to attract demand. Trying to grow both sides evenly and globally from day one is how marketplaces stall.

For product teams, the lesson is that a marketplace's OMTM is almost always liquidity, not raw user count. A million buyers who cannot find what they want is a worse business than a thousand who reliably can, so the metric to move is the match rate, not the headcount.

Chapter 14

What Stage Are You At?

Knowing your model is only half the engine. The same business needs completely different metrics depending on how far along it is, and confusing the stages is the most common way teams chase the wrong number.

The book lays out five stages every startup climbs: Empathy (find a real problem worth solving), Stickiness (build something people use and come back to), Virality (get that usage to spread), Revenue (make the money math work), and Scale (grow it past the founders).

The stages are gates, not labels. Each has an exit condition you should meet before advancing, and skipping ahead backfires. Buying growth before the product is sticky just fills a leaky bucket; chasing revenue before you have retention prices something people were about to abandon anyway.

For a PM, the single most useful act here is an honest stage diagnosis. Teams love to work on the exciting later stages, virality and scale, while quietly sitting on an unsolved stickiness problem. Naming your true stage tells you which metric you are actually allowed to care about right now.

Chapter 15

Stage One: Empathy

Before anything else, you have to prove the problem is real. The Empathy stage is about getting out of the building and understanding a specific group of people well enough to know that something genuinely hurts them, and that they would change to fix it.

The main tool is the problem interview, done at volume. The book's rough heuristic is to talk to enough people, on the order of a few dozen, that clear patterns emerge, and to listen for problems rather than pitch solutions. The metric that matters is qualitative: are you consistently hearing about the same real pain.

This stage draws its own line in the sand. You have exited Empathy only when you can state a problem people confirm they have, a solution they say would address it, and evidence they are dissatisfied enough with today's alternatives to switch. Warm politeness in interviews is not that evidence.

For product teams inside larger companies, the discipline still holds: no roadmap bet should clear planning until someone can show real conversations proving the problem exists. The PM job in Empathy is to bring back believable evidence of pain, not a feature request dressed up as research.

Chapter 16

Stage Two: Stickiness

With a real problem confirmed, the next risk is whether you can build something people actually use and keep using. Stickiness comes before growth for a hard reason: getting more users into a product they abandon only makes you fail faster and more expensively.

The metric that matters here is retention and engagement, not signups. Do people come back on their own, use the core feature, and form a habit? Active usage and repeat visits are the honest signals; total registered accounts is the vanity number that hides a retention problem.

The counterintuitive move is to improve the product for existing users before chasing new ones. If your current users are not sticking, adding more at the top of the funnel is pouring water into a bucket with a hole in it. Fix the hole, then turn on the tap.

For a PM, Stickiness reframes the roadmap fight between "grow" and "improve." Until the retention curve flattens into a stable, returning core of users, engagement work is not competing with growth work; it is the prerequisite for it to pay off at all.

Chapter 17

Stage Three: Virality

Only once a product is sticky does it make sense to focus on spreading it. Virality is not a growth hack bolted on late; it is what you earn the right to pursue after people already love the thing enough to come back on their own.

Three kinds of viral spread

  • Inherent virality: the product spreads because using it means involving others, like a shared document or a payment request.
  • Artificial virality: spread engineered through incentives, such as referral rewards or unlock-by-inviting mechanics.
  • Word of mouth: organic recommendation, the hardest to measure but often the most durable.

The number that matters is the viral coefficient, how many new users each existing user brings, combined with the cycle time, how fast that happens. A coefficient above one means true exponential growth; below one, invitations still usefully lower your effective acquisition cost.

For a PM, the lesson is to build sharing into the core loop rather than sprinkling "invite a friend" buttons on top. Virality that comes from the product doing its job spreads on its own; virality bribed with incentives stops the moment the incentive does.

Chapter 18

Stage Four: Revenue

Now the question becomes whether the business actually works as a business. The Revenue stage is about proving you can make money in a way that scales, and the sharpest framing in the book is simple: build a machine where a dollar in reliably produces more than a dollar out.

That reduces to two numbers in tension: customer lifetime value and customer acquisition cost. When LTV comfortably exceeds CAC, you have a working money machine you can pour fuel into. When it does not, growth only accelerates your losses.

A key shift here is from raw growth to revenue per customer and unit economics. It is better, at this stage, to grow a little slower with healthy margins than to grow fast on unprofitable customers, because unprofitable scale is just a faster route to running out of money.

For product teams, Revenue is where pricing, packaging, and monetization move from afterthought to core roadmap. The PM learning is to treat the LTV-to-CAC ratio as a product metric, not just a finance one, because most of the levers that move it, activation, retention, upsell, live inside the product.

Chapter 19

Stage Five: Scale

With a proven, profitable model, the final stage is growing it beyond the founding team and the first market. Scale is about building the machine and the organization that let the business get much bigger without falling apart.

The metrics broaden accordingly: market share, channel and partner performance, margins as you grow, and the health of the organization itself. The risk shifts from "does this work" to "does this keep working when it is ten times larger and run by people who were not there at the start."

A subtle danger of Scale is that the very focus that got you here can calcify. Systems and processes that create efficiency can also smother the experimentation that found the opportunity, so scaling companies have to deliberately protect room to keep learning.

For a PM, Scale changes the job from finding product-market fit to defending and extending it: entering adjacent segments, hardening the core, and keeping the metric discipline alive as the company grows past the point where everyone naturally knows the one number that matters.

Chapter 20

Model + Stage Drives the Metric You Track

This chapter is where the two halves of the engine snap together. Your business model tells you which family of metrics governs your economics; your stage tells you which one of them is the riskiest right now. The intersection is your One Metric That Matters.

A SaaS company in Stickiness watches engagement and early retention; the same company in Revenue watches churn and expansion revenue; in Scale it watches efficient, profitable growth. Same model, three completely different OMTMs, chosen by where the risk currently sits.

The practical output is a grid: six models down one side, five stages across the top, and a suggested focus metric in each cell. It is not meant as gospel but as a starting point that stops you from importing a number that belongs to a different business or a different phase.

For product teams, this is the chapter to keep on the wall. Before every planning cycle, locate yourself on the grid honestly, then let that cell, not the loudest stakeholder or the shiniest dashboard, nominate the metric the roadmap is allowed to serve.

Chapter 21

Am I Good Enough?

Part Three opens the benchmark half of the book. A metric on its own answers "what is my number"; a benchmark answers the far more useful question, "is that number any good." Without an outside reference, you cannot tell triumph from mediocrity.

The honest answer to "what is a good conversion rate" is "better than yours was last month, and at least as good as a typical competitor." Improvement over your own past and comparison against your industry are the two references that turn a bare number into a judgment.

The book offers rough industry lines in the sand for each model, with a heavy caveat: they are starting points, not laws, and your own trend line usually matters more than any external average. A benchmark tells you roughly where you stand; your own trajectory tells you whether you are winning.

For a PM, the discipline is to always report a metric with two comparisons attached: versus our own history, and versus a credible benchmark. A number with no reference invites everyone to project their own hopes onto it, which is exactly what the good-metric idea exists to prevent.

Chapter 22

E-commerce: Lines in the Sand

For online stores, a handful of benchmark ranges frame whether the model is healthy, always to be treated as rough guides rather than targets to game.

  • Conversion rate: low single digits is common, with a couple of percent seen as a normal baseline and roughly ten percent as genuinely excellent.
  • Cart abandonment: routinely very high, often around two-thirds of started checkouts, so recovering even a slice of it is valuable.
  • Repeat purchases: the book's sharpest rule of thumb splits businesses by how many customers buy again within a year.

That repeat-purchase split is the load-bearing benchmark. If well under half of your customers buy again within a year, you are effectively an acquisition business and should invest in winning new buyers. If well over half return, you are a loyalty business and should invest in retention and average order value.

For a PM, the number to find first is that annual repeat rate, because it decides your whole strategy. Optimizing loyalty features for a business that lives on new-customer acquisition, or vice versa, is effort aimed at the wrong half of the funnel.

Chapter 23

SaaS: Lines in the Sand

Subscription businesses live and die by two benchmark numbers: how many trials become payers, and how many payers leave each month.

  • Free-to-paid conversion: for open freemium products, only a low single-digit percentage of free users typically ever pay, so freemium needs huge top-of-funnel volume to work.
  • Trial conversion: paid or card-required trials convert far better than freemium, often a meaningful double-digit share, because the people who start them are pre-qualified.
  • Monthly churn: healthy SaaS keeps it low single digits; around five percent a month is a warning sign that caps how big you can grow.

Churn is the number to watch obsessively because it compounds. A business losing five percent of customers monthly is running up a down escalator, and past a certain size every new sale merely replaces a departure instead of growing the base.

For a PM, the benchmark lesson is that the choice between freemium and free-trial is really a choice about which funnel you must be world-class at: enormous acquisition volume for freemium, or tight activation and conversion for trials. Pick the one your product and channels can actually support.

Chapter 24

Free Mobile App: Lines in the Sand

For free apps, the benchmarks all circle the same hard truth: a very small share of users pays, and everything depends on retention and the value of that paying core.

  • Paying share: often only a low single-digit percentage of active users ever spend money, so growing that fraction even slightly moves revenue a lot.
  • Retention: a large portion of installs are gone within days, making the drop-off from install to day-one and day-seven use the number that predicts survival.
  • Revenue per user: average revenue per daily active user, and per paying user, are the yardsticks for whether monetization justifies acquisition.

Because most installs churn fast and paid acquisition rarely pays back, a free app cannot buy its way to health. It works only when retained users are worth enough and bring enough friends to subsidize the free majority.

For a PM, the benchmark to defend is early retention. If day-one and day-seven numbers sit below the norm for your genre, no monetization tuning downstream will matter, because there will not be enough surviving users left to monetize.

Chapter 25

Media Site: Lines in the Sand

For ad-supported media, benchmarks track two things at once: how engaged the audience is, and how efficiently that engagement turns into ad revenue.

  • Engagement: pages per visit, time on site, and return frequency, the signals that an audience is real and loyal rather than accidental traffic.
  • Advertising performance: click-through rates that are typically a small fraction of a percent, plus revenue per thousand impressions as the core monetization yardstick.
  • Inventory and fill: how many ad slots exist and how many sell, since unsold inventory is engagement you failed to monetize.

The benchmark tension is permanent: raising ad load lifts short-term revenue per visit but lowers engagement, which shrinks future audience. A healthy media site holds ad density below the point where it starts driving readers away.

For a PM, the leading benchmark to guard is engagement, not revenue. Because ad income lags audience health, a slip in time-on-site and return visits is the early warning that revenue benchmarks will be missed a quarter or two later.

Chapter 26

User-Generated Content: Lines in the Sand

For community and content platforms, benchmarks measure participation: how much of the audience contributes, and how often everyone returns.

  • Participation: contributors are usually a small minority, echoing the "1 percent create, 9 percent react, 90 percent consume" pattern, so lifting the creator share is the key lever.
  • Engagement frequency: the split between daily and monthly active users shows whether the community is a habit or an occasional stop.
  • Content quality: the share of contributions that are genuinely good rather than spam, since quality is what sustains the audience.

The benchmark that matters most is the move from passive to active. A platform where a slightly larger fraction of visitors create content has a fundamentally healthier engine than one with more total visitors but the same thin sliver of contributors.

For a PM, this means measuring the participation funnel as seriously as a store measures checkout. The metric to move is the conversion of lurkers into contributors, because that is the rung of the ladder that compounds into a living community.

Chapter 27

Two-Sided Marketplaces: Lines in the Sand

For marketplaces, the benchmarks are about balance and liquidity: is there enough supply to satisfy demand, and do transactions actually happen.

  • Liquidity: the share of listings that sell, and of searches that find a match, the truest sign that the market works.
  • Balance: the ratio of buyers to sellers, watched separately because the two sides rarely grow in step.
  • Take rate and transaction volume: the slice you keep and the total trade flowing through, which together define the revenue.

The benchmark trap is celebrating total users on either side while liquidity is poor. A marketplace with lots of buyers who cannot find what they want, or sellers whose listings never move, is failing at the only thing a marketplace is for.

For a PM, the number to hold yourself to is the match rate, listings sold or searches fulfilled. Growing headcount on either side without improving the odds of a successful transaction is vanity growth that hides a broken market underneath.

Chapter 28

What to Do When You Don't Have a Baseline

Sometimes you are doing something genuinely new and no benchmark exists. That is not a reason to abandon lines in the sand; it is a reason to set your own from first principles and your own early data.

The practical method is to bootstrap a baseline. Run the product for a short period to establish where you actually are, then set an improvement target against that starting point. Your own last month becomes the benchmark, and beating it becomes the goal.

You can also reason toward a line from the economics: work out what a metric would need to be for the business to work at all, and treat that as the bar. If the unit math only closes at a certain retention or conversion rate, that required number is your line, benchmark or not.

For a PM launching something without comparables, the lesson is to commit to a threshold anyway. A self-set line, honestly drawn before the results arrive, still protects you from the after-the-fact rationalization that ruins decisions; the absence of an industry average is no excuse to skip it.

Chapter 29

Selling into Enterprise Markets

Lean Analytics assumes fast feedback loops, but selling to large enterprises breaks that assumption: sales cycles run months or years, customers are few, and you cannot A/B test your way through a procurement committee. The method has to adapt.

The core adaptation is to find your feedback where the long sales cycle hides it. Instead of usage metrics from millions of users, you track pipeline stages, the reasons deals stall or die, and the qualitative signals from a handful of design partners who agree to build alongside you.

Enterprise buyers also want the opposite of constant change. Where a consumer product iterates in public, an enterprise customer wants stability, security, and a roadmap they can plan around, so the lean learning happens in close partnership before the sale, not through rapid public releases after it.

For a B2B PM, the takeaway is to treat a small number of engaged enterprise customers as your experiment platform. Deep, structured conversations with a few real buyers replace the high-volume tests you cannot run, and the metric that matters becomes learning velocity per customer, not per user.

Chapter 30

Lean from Within: Intrapreneurs

Applying lean analytics inside a large, established company brings a different set of obstacles than a startup faces. The blank-page freedom of a startup is replaced by legacy systems, internal politics, existing brand risk, and stakeholders who measure success by very different numbers.

The intrapreneur's advantages are real, though: existing customers to interview, data already flowing, distribution, and resources a startup would kill for. The challenge is permission and focus, not raw capability. The work is as much about managing the organization as the product.

A crucial move is to negotiate for a real line in the sand with leadership up front: an agreed metric and threshold that defines whether the internal bet succeeded, so the project is judged on evidence rather than on whether it happened to please the loudest executive. Without that agreement, internal projects get killed or continued for political reasons.

For a PM inside a big company, the lesson is that the same OMTM discipline works, but you must also secure the autonomy to act on it. A metric you are not empowered to respond to is just a report, so winning the mandate to experiment is part of the product job, not separate from it.

Chapter 31

Conclusion: Beyond Startups

The closing argument is that this is a way of thinking, not a startup-only toolkit. Any organization trying to reduce uncertainty, a nonprofit, a government program, a personal goal, benefits from naming its riskiest assumption, finding the metric that tests it, drawing a line in the sand, and running an honest experiment.

The recurring warning is against measurement for its own sake. Collecting numbers feels like progress but is not; the value comes only when a metric is tied to a decision you will actually make differently based on the result. Data you would ignore is data you should not be gathering.

There is also a caution about optimizing the wrong thing well. Lean analytics makes you efficient at hill-climbing, so it matters enormously that you are climbing the right hill. Step back periodically to ask whether the whole goal, not just the current metric, still makes sense.

For a PM, the lasting habit is to pair relentless focus on one metric with periodic zoom-out. Move the OMTM this month, but every so often ask whether the mountain is still worth climbing, because the discipline that makes you fast is exactly the discipline that can make you efficiently wrong.

Synthesis

The Entire Book in One Framework

The whole book reduces to a single sentence: know your business model and your growth stage, and their intersection tells you the One Metric That Matters right now. Everything else, the frameworks, the benchmarks, the interviews, exists to help you find that one number and honestly move it.

It runs as a loop. Identify the riskiest assumption, pick the metric that tests it, draw a line in the sand for success, run a cheap experiment, learn, and then repeat, because moving one metric past its line simply reveals the next riskiest thing and a new metric to chase.

The two axes make it concrete. Down one side, six models set your economics; across the top, five stages, Empathy, Stickiness, Virality, Revenue, Scale, set your current risk. Locate your cell, and the roadmap has its focus.

Lean Analytics is not "measure everything." It is the discipline of measuring one thing, the number that maps to what is most likely to kill you right now, deciding in advance what good looks like, and having the honesty to believe the answer even when it is not the one you hoped for.

Cheat sheet

10 Most Important Takeaways

  • You are your own worst source of bias; analytics exists to tell you the truth your optimism is hiding.
  • Pick One Metric That Matters, the number tied to your current biggest risk, and let it focus the whole team.
  • A good metric is a rate or ratio, comparable, understandable, and behavior-changing; everything else is vanity.
  • Draw a line in the sand before you measure, so data settles a decision instead of decorating one.
  • Be data-informed, not data-driven: numbers optimize a known model, but human judgment changes the model.
  • Name your business model, because a SaaS, a marketplace, and a media site are driven by different economics.
  • Climb the stages in order, Empathy, Stickiness, Virality, Revenue, Scale, and do not skip a gate.
  • Fix stickiness before you buy growth, or you are pouring users into a leaky bucket.
  • Prove a dollar in makes more than a dollar out before you try to scale, or scale accelerates your losses.
  • Benchmark every number against your own past and your industry, and beware optimizing the wrong hill well.

The deepest idea is not any single metric or model. It is the reversal of default optimism into disciplined doubt: assume you are probably wrong about something important, find the cheapest honest test of it, decide in advance what would change your mind, and then actually change it. The teams that win are the ones willing to go looking for their idea's flaws while looking is still cheap.