Adam T. Sutton

Optimization Summit: Tests with poor results can improve your marketing

June 3rd, 2011

Day one of 2011 Optimization Summit has come and gone. Many of us have vertigo, either from the amount of content we absorbed, or the view from the rotating restaurant atop the Westin, the tallest hotel in the Western Hemisphere.

Yesterday’s sessions were rich with insights from experts and marketers presenting their experiences in optimization. I Dr. Flint McGlaughlinsay “experiences” because, as we saw, not every test improves results. But every valid test offers valuable insights.

Dr. Flint McGlaughlin, CEO & Managing Director of MECLABS, addressed this point head-on in the day’s first session. McGlaughlin presented examples of landing pages tests that brought greater than 50% declines in response.

Was Dr. McGlaughlin feeling woozy? Did he sit in the rotating restaurant too long before his session? Actually, no. Dr. McGlaughlin illustrated that even tests with poor results can reveal valuable insights about an audience.

“The goal of a test is to get a learning, not a lift. With enough learnings, you can get the real lift,” he said.

Landing Page results two tests

The above image features the tests McGlaughlin touched on. If you’ve seen such results, then you’ve probably asked yourself “well, what do we do now?” Part of the answer came from Boris Grinkot, Associate Director of Product Development, MarketingSherpa, in a later session. Grinkot mentioned two typical reasons landing page visitors do not convert:

1. The page does not offer what visitors want

2. The page does not clearly explain that you have what visitors want (or why they want it from you)

These two causes can help identify the causes of poor landing page performance, and what you should test to improve results.

With this in mind, the researchers tested a final treatment that featured drastically shorter copy. The idea was to get out of the way — to clearly show visitors that the site had what they wanted and to make it easy to get.

Landing page treatment 3

This treatment increased conversion rates by 78%. Why?

The marketing channel driving traffic to the page had already done the selling, Dr. McGlaughlin said. The page did not have to convince  visitors to convert — they were ready to convert. The previous treatments were impeding them.

The results of the previous two tests helped the researchers form this hypothesis and create the third treatment. Even though the two tests had abysmal results, they gave the team enough insights to identify a better treatment that would generate a real lift in response. So even tests with poor performance can improve your marketing — they just might not have improved it yet.

Related resources

Optimization Summit 2011

Landing Page Optimization: 2 charts describing the best page elements to test and how to test them

Marketing Research Chart: Top website objectives to determine optimization priorities and tactics

Landing Page Optimization: Minimizing bounce rate with clarity

Optimization and A/B Testing: Why words matter (for more than just SEO)

Members Library – Online Marketing: Website redesign leads to 476% increase in page views and 64% lower bounce rate

Members Library – Campaign Analysis: Optimization expert lists 5 tweaks to boost an email campaign’s conversions

Adam T. Sutton

About Adam T. Sutton

Adam T. Sutton, Senior Reporter, MarketingSherpa
Adam generates content for MarketingSherpa's Email and Inbound Marketing newsletters. His years of experience in interviewing marketers and conveying their insights has spanned topics such as search marketing, social media marketing, ecommerce, email and more. Adam previously powered the content behind MarketingSherpa's Search and Consumer-marketing newsletters and carries that experience into his new role. Today, in addition to writing articles, he contributes content to the MarketingExperiments and MarketingSherpa blogs, as well as MECLABS webinars, workshops and summits.

Prior to joining MarketingSherpa, Adam was the Managing Editor at the Mequoda group. There he created content and promotions for the company's daily email newsletter and managed its schedule.

Categories: Research And Measurement, Website And Landing Page Design Tags: , ,



  1. June 3rd, 2011 at 09:05 | #1

    It’s interesting how less somehow always equal more when it comes to sales and marketing. I remember when I first started in sales, one of my mentors said that most people loose the sale because they don’t know how to shut up. Some of these examples are evidence of this.

We no longer accept comments on the MarketingSherpa blog, but we'd love to hear what you've learned about customer-first marketing. Send us a Letter to the Editor to share your story.