Staged Pilots Before Scale

Tactics of Organizational PoliticsInitiatives and OpticsA borderline tactic

Skeptics of a promising initiative insist that it prove itself in staged pilots before it is scaled, so the company learns cheaply while the option to stop is still open.

Borderline: whether this move is justified depends on the situation, and only the person in it can judge.

An example

The head of hospital sales at a cardiac device maker sat on the executive committee that would decide whether to scale a direct-to-patient subscription for at-home heart monitors. The sales head doubted the logistics and worried that hospital customers would see the service as competition. Opposing it outright seemed wrong, so the sales head proposed three staged pilots, each larger than the last, and wrote the scaling criteria into the proposal before the first began: a renewal rate above fifty percent, logistics cost under 40 dollars per patient, and no loss of hospital accounts in the pilot regions. The first two pilots met all three. The third missed the cost target until the team renegotiated a courier contract, and the committee approved a national scale-up in month twenty, eleven months later than the digital team had wanted.

Why it works

Asking for another stage is the easier path for a skeptic: it requires no open opposition and no defense of the existing approach, only reasonable caution, and it spreads accountability across several smaller decisions. Committing to scale before evidence exists looks costlier than paying to learn first. It works best when the initiative's benefits can be measured at a size short of full scale and when the scaling criteria are published before the pilots begin. When criteria are never set and each pilot is called too small, the same caution keeps an initiative from ever reaching scale.

The thinking behind it

Avinash K. Dixit Dixit and Pindyck's Investment under Uncertainty (1994) treats the ability to delay an irreversible investment as an option with value: committing now gives up the chance to wait for better information. Staged pilots buy that information cheaply, which is the legitimate case for the sales head's caution. The option has to be exercised at some point, which is why the clean form publishes scaling criteria and decision dates.

William Samuelson Samuelson and Zeckhauser's Status Quo Bias in Decision Making (1988) found that people choose the option framed as the status quo disproportionately often. A committee asked to scale a new channel is being asked to leave the status quo, and another pilot lets it stay there without ever saying no. Criteria set in advance make the choice explicit, which keeps caution from turning into an indefinite default.

When it fits

Real doubts about an initiative's economics or risks, a role in the decision to scale it, and a way to measure its results at a smaller size are the conditions. You need the discipline to set scaling criteria in advance and to accept the result.

How to use it well

Agree on the questions first. Each stage should answer one thing the scale decision depends on, such as cost per patient, renewal, or the reaction of existing customers.

  • Write the scaling criteria before the first pilot starts, and publish them.
  • Size each stage so it can answer its question with numbers that would convince a skeptic.
  • Set a date for each scaling decision, so caution cannot drift into delay.
  • Say in advance what would make you support full scale.

If the criteria are met, back the scale-up in public, in the same forum where you asked for the pilots.

What it costs and where it backfires

Pilots cost time, and a competitor may move while you test. The initiative's champions will see you as an obstacle, especially if its benefits genuinely need scale to show. The move crosses the line when criteria shift after results arrive, when pilots are deliberately sized too small to prove anything, or when the gate protects your own business from a rival's initiative regardless of the evidence; that is setting the initiative up to fail.

When it is used on you

Champions whose initiative is caught in successive pilots should ask in writing what result would justify scaling, and get it on the record before the next pilot. Show why the benefit requires scale, and look for an outside proof point, such as a customer contract or a board mandate.

Back to the catalog