unspurious.

The sampling illusions · Lead-time & length-time bias

Five-year survival keeps rising. Nobody lives longer.

Screening finds cancer earlier — and that alone makes survival statistics soar, even when the disease kills on exactly the same day it always would have. Two quiet biases turn a metric everyone trusts into one that can’t tell whether screening saved a single life.

The same cancer, with and without screening One patient, one fixed date of death — drag to change only how early the screen catches it.
caught at symptoms +2.5 yr earlier
Survival, screened
measured from diagnosis
Survival, not screened
measured from symptoms
age 70
Age at death
the same in both

Fig. 1 — The clock, not the cancer. Both patients have the identical disease and die at age 70. The unscreened one is diagnosed when symptoms appear at 67 — a 3-year survival. Screening finds it earlier, so the screened survival is longer — and past a two-year head start it crosses the famous “5-year” line and joins the success rate. Not one extra day of life; just more of it spent as a patient.

The short answer

What is lead-time bias?

Lead-time bias is the apparent lengthening of survival that happens simply because a disease is diagnosed earlier. Survival is measured from the date of diagnosis, so if screening finds a cancer two years before it would have caused symptoms, the patient records two extra years of “survival” even if they die on exactly the same day they always would have. No life is extended; only the clock starts sooner.

The question that saves you

Did they live longer, or just find out sooner?

When a screening programme reports that survival has soared, there are two completely different things it could mean. Either people are dying later than they used to — a real victory — or they are simply learning they are ill earlier, so the same lifespan is now measured from a sooner starting line. A rising survival rate cannot tell these apart. Only a falling death rate can. Almost every miracle-screening headline confuses the two.

AskDid the death rate fall — or only the survival rate rise?

01 · Lead-time bias

Start the clock earlier and survival looks longer

“Five-year survival” sounds like a fact about how long people live. It is really a fact about a stopwatch: the share of patients still alive five years after diagnosis. Move the moment of diagnosis and you move the number, without touching anyone’s lifespan — which is exactly what screening does.

Take the patient in the figure. Their cancer will end their life at 70 whatever anyone does. Left alone, it announces itself with symptoms at 67, and they “survive” three years — below the five-year bar, a statistic in the failure column. Now screen them, and the same tumour is spotted at 65. Nothing about the disease has changed and death still comes at 70, but the record now shows five years of survival. The patient has been converted, on paper, from a screening failure into a screening success. They have not gained a day. They have lost two years to knowing.

This is why comparing survival rates between countries, eras or hospitals is treacherous: whoever diagnoses earliest — not whoever treats best — wins the survival table.

That last point sank a famous political claim. In 2007 Rudy Giuliani’s campaign ran an advert boasting that a man’s chance of surviving prostate cancer was 82% in America but only 44% in England — proof, it said, of superior American medicine. The survival gap was real (about 98% versus 71% at five years). But the figure that actually counts, the death rate, was almost identical: roughly 26 American men per 100,000 died of prostate cancer against 27 in Britain. America wasn’t saving those men; its heavy PSA screening was simply diagnosing them years earlier, and often diagnosing cancers that would never have troubled them at all.

02 · Length-time bias

Screening skims the slow lane

The second bias is subtler and, if anything, worse. A screen is a snapshot taken at intervals — every year or two. Whether it catches a tumour depends on how long that tumour sits in the window between “big enough to detect” and “bad enough to cause symptoms”. Slow, indolent cancers dawdle in that window for years, so a periodic scan is very likely to land on one. Fast, aggressive cancers tear through it in months and mostly surface as symptoms between scans.

So screening doesn’t sample cancers evenly — it preferentially harvests the slow, mild ones, precisely the cases with the best outlook to begin with. The screen-detected group then boasts wonderful survival, not because screening rescued anyone, but because it skimmed off the least dangerous disease and left the fast killers to the clinic. (This is the same length-biased sampling behind the inspection paradox — long things are easier to catch — only here the “long” thing is a tumour’s harmless spell.)

Why the screen keeps catching the gentle tumours Each bar is one tumour’s detectable window · a screen catches it only if a scan falls inside
screen 1screen 2screen 3slowscreen-detectedfastsymptomsfastsymptomsslowscreen-detectedfastscreen-detectedslowscreen-detectedfastsymptomsslowsymptoms

Caught by a screen Surfaced as symptoms

Fig. 2 — The luck of a long window. A tumour is screen-caught only when a scan (dashed line) falls inside the stretch of time it is silently detectable — its bar. Slow tumours have long bars and are hard to miss; fast ones have short bars and slip between screens. So the screen-detected group fills up with slow, gentle cancers, while the aggressive ones surface later as symptoms. Screening looks brilliant because it is grading itself on the easy cases.

03 · Overdiagnosis

Curing cancers that were never going to kill you

Push length-time bias to its limit and you reach the most troubling idea in screening: overdiagnosis. Some tumours grow so slowly — or not at all — that they would never have caused a symptom in the person’s remaining life. Screening finds them anyway. They are then treated, with surgery, radiation or worse, and every one is counted as a life saved. In truth nothing was saved; a healthy person was turned into a patient and given the risks of treatment for a disease that was never going to hurt them.

South Korea ran the natural experiment. After thyroid screening became cheap and routine in the late 1990s, the number of thyroid cancers diagnosed rose fifteen-fold in under two decades. A triumph, until you look at the death rate: it did not budge. Almost all the extra “cancers” were tiny papillary tumours that would have sat harmlessly for life, and tens of thousands of people had their thyroids removed for nothing. The survival statistics, meanwhile, looked spectacular — because a cancer that could never kill you is a cancer you are guaranteed to “survive”.

A test that finds harmless disease can only ever improve the survival rate. The person it “cured” was never in danger — but now carries a scar, a diagnosis and the risks of the treatment.

04 · How not to be fooled

Reading a screening claim safely

Ask for the death rate, not the survival rate. Survival counts from diagnosis and is corrupted by both biases; mortality — deaths per year in the whole population — is not. If screening truly works, fewer people die. If the boast is only about five-year survival, treat it as no evidence at all.

Distrust survival comparisons across places and times. A country, clinic or decade that screens more will always post better survival, even with identical medicine and identical deaths. That single confusion powered the prostate-cancer claim above.

Ask what happened to the number diagnosed. If diagnoses leap while deaths hold steady, you are almost certainly watching overdiagnosis, not a cure — the fingerprint South Korea left so clearly.

Trust randomised trials with a mortality endpoint. The only clean test is to randomise people to screening or not and count deaths years later. It is slow and expensive, which is why survival rates are quoted instead — they are available, flattering and, for judging screening, close to meaningless.

Don’t confuse this with the Will Rogers phenomenon. That one improves the averages of two groups by reclassifying patients between them; here, better detection inflates a single survival clock and cherry-picks the gentle cases. Cousins in the family of screening statistics that flatter without helping.

Continue the field guide

More ways survival statistics mislead