All Things PM
The Infrastructure Behind the Machine Age
The a16z ShowStrategy

The Infrastructure Behind the Machine Age

a16z is raising a fund for the layer beneath the model: chips, memory, power, cooling, data centers. The partners explain why capital now converts almost directly into intelligence, why everything is sold out to 2028, and why treating AI agents as employees is the durable way to adopt them.

August 28, 2026 · 55 min listen · 11 min read · Ben Horowitz, Martin Casado
0:00
–:––

Context

a16z general partners (including Ben Horowitz and Martin Casado) announce the "Machine Age Fund," dedicated to the infrastructure powering AI: chips, memory, networking, power, cooling, and data centers. Their thesis is that the model is no longer the bottleneck; everything underneath it is, and all of it is being pushed past what it was designed to handle. Much of the episode is a hardware and macro discussion (gigawatts, DC power, reinforced concrete) that is peripheral to product work, but the strategic and organizational arguments underneath it are broadly useful: how AI changes the old rule that money cannot buy engineering speed, how competitive markets fragment and reopen for new entrants, and how to actually adopt AI agents inside an organization.

The Big Idea

In the AI era, capital converts almost directly into compute, and compute into more capable intelligence, which removes the old "engineering governor" that used to cap how fast money could buy progress. The binding constraint has moved from the model to everything underneath it, and that bottleneck migration is where the next decade of value sits.

The old rule (from The Mythical Man-Month) was that throwing more engineers at a problem does not make it go faster. The partners argue AI breaks that: within limits, more money buys more compute buys more capability, with no natural engineering ceiling in between.

Key Insights

Capital now converts into intelligence

The core mental shift. Historically, money went into an engineering problem, took a known amount of time, often failed, and eventually produced a product, with engineering physics (the mythical man-month) as a natural governor in the middle.

  • What changed: now there is little between the money going in and intelligence coming out. As long as you have capital, GPUs, and data, you can scale capability, because AI's answer to getting better is simply to use more compute.
  • The competitive consequence: a two-year software lead used to be defensible, because a rival hiring 1,000 engineers to catch up would wreck their own company. Now a rival can spend billions to light up a cluster and a serious competitor "comes out of nowhere." Leads are less durable when money buys capability directly.
  • Why it matters for PMs: the old intuition that "you cannot just throw money at this" is weakening for AI-driven work. Advantage shifts toward whoever can marshal capital and compute, not just whoever has the head start.

The bottleneck moved south of the model

For three years models steadily improved to the point where the model is no longer the limiting factor. The bottleneck is now "south of the model": chips, memory, networking, power, cooling, and data centers, none of which were designed for AI workloads.

  • Why it matters: when one layer stops being the constraint, value and opportunity migrate to the next layer down. The partners note that top founders saw this early, with the share of strong teams tackling hard hardware problems rising from roughly 3 to 5 percent to north of 20 to 30 percent.
  • The general lesson: always ask where the binding constraint actually is right now, because it moves. Optimizing the layer that is no longer the bottleneck wastes effort; the leverage is at the new constraint.

Demand is pre-sold, not speculative

A direct answer to "is this another hype cycle?" The partners contrast today with the dot-com fiber build-out, when much of the capacity laid was speculative and sat dark because the users were not there yet.

  • The signals now: hyperscaler capex is exploding (toward roughly $700B this year, possibly $1T next), core components are booked out to 2027 or 2028, GPUs resell at around 4x, and a leading memory maker said current demand alone would take three years of capacity to supply. Nearly every GPU made is pre-sold.
  • The contrast that matters: in the fiber era supply outran real demand; here demand outruns supply, with token consumption growing on the order of 1000% a year. The lesson for reading any boom: distinguish speculative capacity (built ahead of unproven demand) from pre-sold capacity (bought before it exists), because they mean opposite things about durability.

Every unit of work multiplies tokens

A pattern with direct cost implications. As products moved from chat to reasoning to agents to multi-agent systems, the number of tokens a single task consumes rose by about five orders of magnitude.

  • Why it keeps happening: the current way to make AI better is to use more inference (reinforcement learning, chain of thought, long-running agents all burn tokens), and there is no natural regulator to level it off the way engineering physics used to cap software.
  • For PMs: assume the token (and therefore cost) intensity of your AI features will keep climbing as you add reasoning and agents, not level off. Plan capacity and unit economics for a workload that expands by orders of magnitude, not increments.

Treat AI agents as employees

The most transferable organizational insight, credited to Martin Casado. The industry cycled through framings of AI: a smarter search bar, then a chatbot, then an "extension of you" that shares your keys and passwords. What some agent products got right is treating the agent as an actual employee: it has its own computer and browser, no special access to your keys, and can do what an employee can do.

  • How it behaves: you can give it a high-level task (triage my email) and it does sophisticated things, including knowing to check with you before acting.
  • The management reality (Horowitz): these are a new kind of employee, and there is a learning curve. They can burn tokens and money and get nothing done, forget things, make things up, and create security problems, but they can also be extremely productive. The goal is not to automate humans away; it is to "make all our humans superhuman without wrecking the place."
  • Why it matters: the durable way to integrate agents is to manage them like a new class of worker (with oversight, guardrails, and defined responsibilities), not to bolt them on as a feature.

Markets fragment, then consolidate

Why new companies can break in even against multi-trillion-dollar incumbents like Nvidia. The partners frame it as a law of markets: as markets expand they fragment, and only when growth slows do they consolidate (through acquisition or new challengers).

  • The math: even 5% of a multi-trillion-dollar incumbent's market is a massive private company. Incumbents chase the 90% (their "gold bricks") and rationally ignore the smaller opportunities (the "silver bricks"), leaving room at the margins.
  • Why it applies now: use cases are multiplying so fast that no single company can serve them all well, and many of the un-served ones are very valuable. The pattern generalizes: rapidly expanding markets create entrant opportunities precisely because the biggest players cannot bend down to pick up every valuable niche.

Mental Models & Frameworks

Capital to compute to intelligence

A model for AI-era strategy: money converts into compute, and compute converts into capability, with no engineering-physics governor in between. Contrast it with the old model (money into an engineering effort, throttled by the mythical man-month, out the other end a product). Use it to reason about where advantage accrues (toward capital and compute access) and to sanity-check any plan that assumes a lead is safe because rivals "cannot just spend their way in."

Bottleneck migration

Constraints move. When models stopped being the limiter, the constraint moved to the hardware beneath them; when that eases, it will move again ("bottlenecks will move and there will be more complexity elsewhere"). The discipline is to keep re-identifying the current binding constraint rather than optimizing yesterday's. Applied to any product: find the one layer actually limiting the outcome now, and put effort there, not on the layer you are used to working on.

First-principles component redesign

The method the partners describe for rebuilding infrastructure for AI: take an existing design, break it down to fundamental components (for an inference engine: memory, compute, how they talk, power, cooling), ask what each truly needs for this specific workload, and rebuild from those building blocks. The vivid version is the "ASIC per model" idea: if a model costs several billion to build and inference must earn that back, a 20% efficiency gain can be worth billions, enough to justify custom silicon for a single model. The reusable move: when a system is hitting the limits of a design built for a different era, decompose it to fundamentals and rebuild around the actual workload rather than tuning the inherited architecture.

Decision Principles

Principle: Invest where the constraint just moved

  • When: deciding where to build or place effort in a fast-moving stack.
  • Why: value migrates to whatever layer has become the binding constraint. Models improving turned the hardware beneath them into the scarce, high-leverage layer. Following the constraint down (or up) the stack, rather than staying where you have always worked, is where the outsized opportunity is.

Principle: Read demand by whether it's pre-sold

  • When: judging whether a boom is real or speculative.
  • Why: speculative capacity is built ahead of unproven demand (dot-com dark fiber) and can sit idle; pre-sold capacity is spoken for before it exists (today's GPUs and memory). The same headline "huge build-out" means opposite things depending on which one it is, so check whether the demand is already committed before concluding a market is overheated or durable.

Trade-offs & Nuance

Automating away vs augmenting people

The partners are explicit that they have not "cracked the code" of a fully automated firm, and that is not the goal. The realistic trade-off with AI agents is between trying to replace humans (which risks the bots getting out of control, burning money, and creating security problems) and using agents to make existing people dramatically more productive. Their stance lands on augmentation: integrate agents as a managed new kind of worker to make humans superhuman, rather than chasing full automation and wrecking the organization in the process.

Practical Application

Plan for token intensity to keep rising

Model your AI feature's cost assuming token consumption climbs by orders of magnitude as you add reasoning, agents, and multi-agent workflows, because there is no natural leveling-off. Do not budget as if today's per-task token cost is stable; the trend across the industry has been five orders of magnitude of growth as capability deepened.

Adopt agents as a managed workforce

Treat AI agents like a new class of employee: give them defined tasks and their own scoped access rather than your personal keys, expect a learning curve, and put oversight in place for their failure modes (wasting money, forgetting, fabricating, creating security holes). Aim to make your existing team superhuman with them, not to replace the team, which the partners found is the durable integration pattern.

Hunt the niches incumbents won't stoop to

If you are entering a market dominated by a giant, look for the valuable "silver bricks" the incumbent rationally ignores because it is busy with its "gold bricks." In a rapidly expanding market, use cases multiply faster than any one company can serve, so a small share of a huge market can still be a large business. Identify the valuable niche the leader has no incentive to chase.

Questions to Consider

  • Where is the binding constraint in our product or stack right now, and has it recently moved (the way the AI bottleneck shifted from the model to the hardware beneath it) such that our effort is aimed at the wrong layer?
  • Are we assuming our lead is safe because rivals "can't just spend to catch up," in a domain where capital now converts fairly directly into capability?
  • As we add reasoning and agents, have we planned our cost and capacity for token consumption that could grow by orders of magnitude, rather than staying flat?
  • Are we integrating AI agents as a managed new kind of employee (scoped access, oversight, defined tasks) or bolting them on as a feature and hoping they behave?
  • If we are entering a market with a dominant incumbent, which valuable niche is that incumbent rationally ignoring because it is too small relative to their core business?

Bottom Line

The Machine Age thesis is that capital now converts almost directly into compute and compute into intelligence, so the binding constraint has moved from the model to the chips, memory, and power beneath it, and demand there is pre-sold rather than speculative. The transferable lessons for builders: chase the constraint wherever it just migrated, plan for token costs that keep multiplying, adopt AI agents as a managed new workforce that makes humans superhuman rather than replacing them, and remember that fast-expanding markets fragment, opening room even against trillion-dollar incumbents.

Notable Quotes

"Increasingly capital can be converted directly into compute, and compute into more capable intelligence." (host, framing the fund)

"I have so many gold bricks I can't even pick them all up." (Dan Rose, recounted by the partners, on why a giant ignores smaller opportunities)