A new CTA producing a small positive topline lift is rarely a real win. Most of the lift is clicks redirected from higher-converting positions on the same page.
TL;DR
- Adding a new CTA to a high-traffic surface usually produces a small positive headline lift.
- That lift is rarely net-new conversions. More often it's clicks that would have come from existing CTAs at higher conversion rates, redistributed to a less-efficient destination.
- The diagnostic is per-CTA click distribution: pull click volume and click-to-conversion rate for every CTA on the page, in both arms.
- Cannibalization signature: existing CTAs lose click volume in the variant; new CTA has sub-baseline click-to-conversion ratio; total conversions roughly flat.
- Adding three columns to your test report catches it. Skipping the diagnostic is how programs degrade their funnel composition for years.
The two outcomes look identical on the topline
| Outcome | Headline metric | Total page clicks | Conversion efficiency | Decision |
|---|---|---|---|---|
| Real win (additive engagement) | +1% to +3% | Up | New CTA matches or beats existing-CTA click-to-conv | Ship |
| Cannibalized "win" (redistributive) | +0.5% to +1.5% | Up | New CTA has sub-baseline click-to-conv; existing CTAs lose click volume | Do not ship |
Both produce a positive topline directionally. The difference shows up only in the per-CTA breakdown. Without the breakdown, the team ships cannibalization disguised as growth.
Worked example: a sitewide nav CTA that almost shipped
A sitewide navigation button added to every page of the site. Modeled on a sister-brand pattern that had been live for years.
| Metric | Result |
|---|---|
| Plan-selection page entry | +1.07% (sample size 300k+ per arm) |
| Downstream confirmation | +0.96% |
| Both within noise floor, directionally positive | "Looked like" a win |
The aggregate said ship. The per-CTA breakdown said the opposite.
| CTA | Clicks (variant arm) | Click-to-page-entry rate |
|---|---|---|
| New nav CTA | ~7,000 | ~6% |
| Existing inline CTAs (avg) | ~5,000 | ~25% |
| Implication | Total clicks up | New CTA is 4-5× less efficient than existing |
Roughly 47% of the new CTA's clicks came from customer-support pages where audience intent was "log in," not "shop." The variant was cannibalizing high-converting clicks from prospect pages and recapturing them on a low-converting modal flow. The topline +1.07% was the residual net of (new clicks − cannibalized clicks). Most teams stop at the topline. The funnel composition had degraded.
Decision: do not ship. The CTA stayed off the global nav until copy + routing iterations addressed the source-page intent mismatch.
What the diagnostic catches
The cannibalization signature is consistent. Pull these three numbers per arm and the picture sharpens fast.
| Diagnostic column | Real win signature | Cannibalized "win" signature |
|---|---|---|
| Existing CTAs click volume | Holds steady or grows | Loses click volume in variant |
| New CTA click-to-conversion rate | Matches or exceeds existing CTAs | Sub-baseline (often <half existing) |
| Source-page breakdown | Most clicks from intent-matched pages | Significant share from wrong-intent pages |
If two of three signatures point at cannibalization, the test should not ship even if the topline says directional positive. The topline is real but the funnel composition is worse than before the test.
Three failure modes the diagnostic catches
| Failure mode | What aggregate shows | What per-CTA breakdown shows |
|---|---|---|
| Wrong-intent clicks | Headline lift on click volume | New CTA captures clicks from source pages where audience intent doesn't match destination |
| Friction injection | Click rate up, conversion flat | New CTA has sub-baseline click-to-conversion ratio because of modal/redirect at destination |
| Cannibalization | Topline lift smaller than expected | Existing CTAs lose click volume; total conversions roughly unchanged |
In every case, the aggregate report is technically correct. The headline number moved on the right side of zero. The team gets a "directional win." The funnel underneath is worse than before the test.
When cannibalization is acceptable
Not every cannibalization signal kills the test. Two patterns where redistribution is genuinely worth it:
| Pattern | Mechanism | When it justifies cannibalization |
|---|---|---|
| Reaching new audience pockets | New CTA pulls clicks from previously-disengaged users | Existing CTAs hold click volume; new CTA adds incremental clicks on top |
| Routing to low-friction destinations | New CTA bypasses a multi-step pre-qualification flow | Per-click revenue lower but conversion rate much higher; total revenue grows |
Both signatures look like "additive engagement," not "redistributive engagement." If the existing CTAs are losing click volume to the new one with no offsetting gain in funnel input, you're in cannibalization territory regardless of what the topline says.
What to add to every CTA test report
Three columns. Each takes one analytics query.
| Column | Question it answers |
|---|---|
| New CTA's click-to-conversion rate | Did the new CTA convert clicks at a healthy rate? |
| Existing CTA click volume per arm | Did the existing CTAs lose volume to the new one? |
| Source-page breakdown of new-CTA clicks | Are clicks coming from intent-matched pages? |
Tests where all three columns look healthy ship. Tests where any column reveals redistribution don't — even if the topline says they do.
The behavioral mechanism
A click is a curiosity event — _what is this_. A conversion is a commitment event — _yes, I want this_. Adding a new CTA to a high-traffic surface raises curiosity events sitewide. That's what visibility does. It does not necessarily raise commitment events at the same rate, because commitment requires:
- Intent alignment between the CTA copy and the destination
- Low friction at the destination
- Content on the destination that matches what the CTA promised
Visibility alone moves only one of the three. Most CTA tests focus on visibility because it's the easiest to spec and the easiest to demo in stakeholder reviews. Cannibalization is the predictable consequence of optimizing visibility without checking whether the new CTA captures incremental commitment or just redistributed curiosity.
Bottom line
A test report that shows aggregate lift without per-CTA composition is incomplete. Pull the per-CTA click distribution and click-to-conversion rate on every CTA test. If the variant arm shows existing CTAs losing click volume to the new CTA at a sub-baseline conversion rate, the win is cannibalized. Do not ship.
The cost of running this diagnostic is one query per test. The cost of skipping it compounds quietly until the funnel is full of CTAs that nobody can defend a unique purpose for.