1. Create A/B test” in the left menu
2. Fill in the fields
- name of the test
- address book
- parameters for comparison — the criteria that will determine the winner
- the winning email sending options — manually or after a specific time period after the test
3. Go to “Mailing A”
The process is the same as for the usual mailing. You need to specify the campaign name, the subject, and the “From” address and choose a template.
(read detailed instructions of how to create an email campaign in Send an email campaign article)
It is desirable to have a ready-made template for an A/B test as it will be used both in A and B mailings with minor changes of the element that needs to be tested.
4. Go to “Mailing B”
If necessary, you can copy the information and content from the first to the second mailing.
Select the information that you want to copy depending on the element you plan to test.
The service allows you to create 5 test mailings. You can create Mailing C, D and so on.
In the example we created two mailings — A and B.
It is worth noting that both of these mailings will be sent to one address book that is automatically divided into segments.
Mailing A – 20% of addresses
Mailing B – 20% of addresses
The final mailing – the final 60% of recipients
The maximum number of test mailings is 5. But remember, your address book will be divided by 20% for each mailing.
- If you create 5 test mailings and divide mailing list into 5 equal parts (20% for each mailing) - there won't be any final mailing.
- You can use a slider and regulate the percentage of email addresses for each mailing manually - this can be done on the last step of A/B test creation.
- If you have less than 40% email addresses left for the final mailing, then it won't be set up and send.
Check each parameter before sending a test campaign:
Is everything all right? Everything set?
Let’s send a test mailing and wait for the results.
NB! The statistics won’t be available right away (only after a couple of hours) so wait until you get the necessary data before sending your final mailing.
Once the test results are ready you can send the final newsletter and improve email marketing.
Note, that if in the mailings statistics you decide to check another mailing as a winner and send it as a final mailing, then just click "Is the winner" under the necessary mailing.
Published: 03 Jul 2017 Last Updated: 08 Oct 2018
Other useful articles
- How to send bulk emails without spamming?
- How to enable and disable web push notifications in Mozilla Firefox?
- How to send bulk emails free?
- How to enable and disable web push notifications in Google Chrome?
- How to send bulk emails in Gmail?
Popular in Our Blog
- TOP 5 email marketing books
- What to write in the preheader?
- Mailing to unreads function
- 5 facts about emails everyone thinks are true
- 8 best ways for opt-in form optimization