The Surprisingly Important Element of Successful Testing

by DigitalAlex on March 30, 2011

Welcome to Digital Alex, where you'll get Actionable Advice for Better Internet Marketing. If you're new, explore my archives and subscribe to my RSS feed.

Source: http://bit.ly/aPzFlC

I’ve had a lot of positions at my current company (ClickEquations, formerly Commerce360), but one of the ones I most enjoyed was a multivariate testing project I did with a large entertainment provider.

In preparing for the project, I read a ton about testing, what to test, past tests that worked, etc. There is no shortage of information about what to test or how to test it (see. www.WhichTestWon.com, for example).

What surprised me about the experience was that very little time was spent talking about the most important elements of a successful test: people.

Specifically, the people you need to help you with a test.

.

CRO & Big Companies

If you manage your own website, launching a test happens in an afternoon and you’re making the calls. If you’re heading up a conversion rate project for a website with hundreds of thousands of visitors a day, it quickly becomes a project convincing people to help you test with some conversion rate optimization attached.

That was the case for the company I worked with, as it was one of their first forays into testing. Getting momentum required buy-in from several key stakeholders:

  1. Champion – We had an awesome internal advocate who prioritized the project and rallied the troops. He served as the central point of contact to coral everything on the client side while my coworker (the account manager) and I got to focus on the testing.
    .
  2. Executive Sponsorship – The client had to lay out money for both software (we used SiteSpect) and our consulting fees. Working on our project also meant diverting hours for contributing departments (see below) from other projects to testing.
    .
  3. Development Buy-In – Every testing project involves some changes to your site in one way or another: DNS changes, tags in footers, Mboxes, etc. The bigger the site, the more cautious the IT and development team. You need to get in their sprint cycle. I recommend you choose a technology that allows you to ask for help from development once and then permits changes on the fly afterward.
    .
  4. Creative – Someone has to create all of those test variations and in bigger companies, they generally have to be sensitive to brand guidelines or other restrictions. More importantly, you need an ally on the creative team who is will to let you butcher their work and possibly test something that, from a design perspective, they may not necessarily agree with.
    .
  5. Analytics – Chances are, there is already someone in the company doing analytics or, as was the case for my client, statistics. You’re going to need access to analytics data to design an effective test and they might even review it with you.

.

Converstion Team Optimization

Testing can fundamentally change how a business operates and where decision making power lies. It also involves new and different business processes. That is to say, testing means change. People, especially bigger companies, are often slow to change.

In my experience, a great Champion and Executive Sponsor set the tone for the rest of the team. They approve budgets, timelines and the allocation of resources. A great process and communication help win over the rest of the team, but that’s for another blog post.

{ 2 comments… read them below or add one }

1 James Mankin April 13, 2011 at 7:00 pm

“Converstion Team Optimization” – typo? Love your content. I’m an aspiring SM Marketer/Manager and certainly appreciate your engagements in the subject. More often than not, I find actionable advice/opine here than the ‘no duh’ moments on larger, less moderated sites. Thanks for your efforts!

2 DigitalAlex April 16, 2011 at 6:21 pm

I’m glad you like it! Thanks for reading. No, that was not a typo. I intended the article to be about the teams responsible for helping you optimize conversion rates.

Leave a Comment

Previous post:

Next post: