Skip to content
NewNew guide. How to get your business into Google AI Overviews.Read it
Conversion & retention Definition

A/B testing

A/B testing compares two versions of one thing, such as a page, ad or email, by showing each to a random half of visitors and measuring which converts better.

Also called
A/B test, split testing, split test, AB test, A/B tests
Category
Conversion & retention
Updated
Sheet
1 of 40

Formula

Relative lift equals rate difference divided by control rate
Rate difference
Variant conversion rate minus control conversion rate, as conversions per 100 visitors.
Control rate
The conversion rate of the original version over the same period.

Worked0.6 ÷ 2.4 = 0.25

Worked example

Clinic booking page

A clinic's booking page converts 2.4 of every 100 visitors. A new version with the doctor's photo and a shorter form converts 3.0. The difference is 0.6, so the lift is 0.6 divided by 2.4, which is 0.25, or 25 percent, but only worth trusting if enough people saw each version.

Why it matters

A/B testing replaces opinions with evidence. Instead of arguing over whether the button should be green or the headline shorter, you split traffic at random, send half to the original (the control) and half to the change (the variant), and see which gets more of the action you care about. Because both run at the same time, season, ad spend and day of the week affect them equally. Google Ads offers the same logic as campaign experiments.

Done properly, it turns small gains into compounding ones. Done badly, it turns noise into confident wrong decisions.

How to run one

  1. Pick one metric, tied to money: bookings, purchases, qualified leads, not clicks.
  2. Change one thing, or one clear idea. If three things change you will not know which one worked.
  3. Estimate the sample first. Use a sample size calculator with your current rate and the smallest lift worth detecting.
  4. Split randomly and run full weeks, so weekday and weekend behaviour both count.
  5. Decide the end in advance, and do not stop the moment the numbers look good.

When not to test

If a page gets 600 visitors a month and converts 3 in 100, a test would take many months to detect anything but a huge change. A school or clinic with low traffic gains more from fixing obvious problems, using customer calls and session recordings, and then comparing before and after.

Common mistakes

  • Peeking and stopping early, which makes false winners.
  • Testing trivial changes on low traffic.
  • Ignoring segments: a win on desktop can be a loss on phones.
  • Not recording the result, so the same test runs again next year.

BridgeE runs this as part of conversion rate optimisation, and says plainly when the traffic is too low to test.

Sources

  1. Set up an A/B test with experimentsGoogle Ads Help · November 2026

Want your a/b testing moving the right way? Bring the number. We'll bring the plan.

Book a call