Advanced testing: What 4,000 A/B tests can teach you

Posted by

SMX Advanced has always featured the industry’s top talent discussing what they’re passionate about: search marketing. Last week’s conference in Seattle was no different.

Ayat Shukairy, co-founder and vice president of client solutions at Invesp, shared nine lessons from 11 years of A/B testing experience. The goal of the presentation was to present the many nuances which go into a successful A/B testing plan. After 4,000 successful conversion rate optimization (CRO) implementations, Shukairy has developed quite a knowledge base.

Ayat Shukairy

Below I have listed Shukairy’s nine key takeaways, along with some additional insights and commentary:

1. We often focus on the wrong thing

Shukairy advised us to stop focusing on the short term. We need to keep our long-term testing plans in mind when executing our strategies.

Additionally, Shukairy reminded the audience to be skeptical of giant lifts in performance; if you see a huge lift in conversion rates (CVR), then check to make sure that (a) you’ve run the test long enough to produce meaningful results, and (b) this test is not an outlier.

[Read the full article on Search Engine Land.]

Some opinions expressed in this article may be those of a guest author and not necessarily Marketing Land. Staff authors are listed here.

About The Author

Jason Puckett is the CEO & Founder of AdBasis. Ad creative optimization is the name of Jason’s game. AdBasis is an A/B and Multivariate testing platform for search, social, display, remarketing & mobile ads. Jason is a digital marketing strategist, ad optimization expert and conversion rate enthusiast. AdBasis has helped over 1,000 companies improve their paid media through creative testing.


Leave a Reply

Your email address will not be published. Required fields are marked *