What we've learnt from randomly testing #EmailWeekly

What we've learnt from randomly testing #EmailWeekly

What we've learnt from randomly testing #EmailWeekly

Bex Osborn

Marketing Strategist

30 Oct 2015

If you receive the #emailweekly regularly, you have been subject to innovative/ridiculous designs, delayed sends, obscure subject lines and the odd error here and there.

Some of these were on purpose, others weren't.

I guess you could say we've kind of learnt something from each one.We like to think of the weekly as a playground for email code so we thought we would bare all for the eyes of our subscribers.

Here is what we've found from AA/AB testing/sending the email weekly so far:

A/A tests (on purpose) EmailWeekly #29 Subject line:

GOOD EMAIL ¿ pheasant! downpour! schist! aaaaa Send time:

6PM Declare winner: 1 hour Overall open rate: 46% Grammar mistakes: 1 Variance: 11.7% EmailWeekly #30 Subject line: EmailWeekly #30: Keeping it alternative Send time: 6:50PM Declare winner: 1 hour Overall open rate: 44% Grammar mistakes: 1 Variance: 9.7% EmailWeekly #43 Subject line: EmailWeekly #43: Lots to report Send time: 12:22PM Declare winner: 1 hour Overall open rate:

45% Variance = 3.7% EmailWeekly #44 Subject line:

Hey there [firstname,fallback=you], just testing subject line length, don't mind me.

Enjoy these articles and I'll see you next week Send time:

1:20PM Declare winner: 1 hour Overall open rate:

47% Variance = 3.3% EmailWeekly #45 Subject line:

Time for a #cheekyemail Send time: 1:10PM Declare winner: 1 hour Overall open rate: 48% Variance:

3.8%Lesson learnt? Subject line B will always win, most of the time.

Other tests:

EmailWeekly #7 Admitting you are testing your subscribers...

but aren't actually.

This is one of our best open rates so far.

Subject line: [Subject line split test A:

this group are much nicer than group B] Send time:

6PM Overall open rate:

54% EmailWeekly #58 Burrito (version B) vs Burger (version A) in the subject line...

Subject line:

do the subject line later, it’s burrito Friday Send time:

4pm Declare winner: 1 hour Overall open rate: 44% Variance: 2% EmailWeekly #57 Subject line: Subjectline Send time: 3pm Observation:

We saw a 6% increase in open rate from the week before and week after.

We'll put that down to curiosity Overall open rate:

48% EmailWeekly Trivia Our highest CTR: EmailWeekly #37. The mystery CTA of course. CTR: 60% Our lowest ever open rate: EmailWeekly #26 Subject line: Decorations? Check. Presents? Check. #EmailWeekly newsletter? CHECK. Send time: 5pm Open Rate: 39% Probable insight:

This was sent at 5pm on the Friday before Christmas, most people have probably logged off by this point to spend time with their families if they aren't already on holiday.

We can only assume. To sum up...

We've learnt that our own random variance stays at about 3% (excl.

the outlier), email marketers prefer burritos over burgers (just) and long subject lines are pretty awesome, don't knock them.

We'll continue with our random tests so you don't have to.Until next time.

Let’s

create

together

Got a project or want to know more about what we do? Drop us a message here, and we'll get back to you.

Let’s

create

together

Got a project or want to know more about what we do? Drop us a message here, and we'll get back to you.

© 2011-2024 Action Rocket Ltd. All rights reserved.