Email marketing

A/B testing

A/B testing is comparing two versions of an email, page or element by showing each to a random group, then measuring which performs better against a chosen goal.

Instead of guessing which subject line, headline or button works best, A/B testing lets real behaviour decide.

In more detail

Good tests change one meaningful thing at a time, set a clear success metric before starting, such as clicks or purchases, and run until the sample is large enough to be confident the difference is real. In email, platforms can test on a small portion of the list and send the winner to the rest. On websites, A/B testing supports conversion rate optimisation. Testing bigger ideas, such as offers or page layouts, usually teaches more than testing button colours.

Why it matters

A/B testing builds a habit of learning from evidence, gradually improving results and settling internal debates with data rather than opinions.

Example

An online course provider tests two email subject lines: one with a question and one with a specific number. The numbered version wins by 18 percent in clicks across three sends, so the team adopts the style.

FAQ

A/B testing: quick answers

How long should an A/B test run?

Until it reaches enough data to be statistically confident, often at least one to two weeks for websites.

Can I test more than two versions?

Yes, that is called A/B/n or multivariate testing, but it needs more traffic.

Free audit

Find out where you stand in search and AI answers.

Get a free audit of your SEO, AI visibility and email setup. We send a short, specific report with the three changes that would move the needle most.