'Net Features : tim ash

Landing Page Testing - Translating the Terminology

Administrator — Thu, 24 Mar 2011 19:00:00 GMT

Before you can start doing any testing on your website landing pages, you need to understand some common concepts and definitions used in landing page testing. But be forewarned: while members of the testing community refer to the same concepts some may use different language to describe them.

The primary objective of landing page testing is to predict the behavior of your audience given the specific content on the landing page that they see. You will collect a limited sample of data during your test, summarize and describe it (descriptive statistics), and predict how people from the same traffic sources will act when interacting with the page (inferential statistics). In other words, the ultimate goal is to find the best possible version of the landing page among all of the variations that you are testing.

Input and Output Variables

A landing page test has two basic components: a set of input variables (also called “independent variables”) that you can control and manipulate, and one or more output variables (or “dependent variables”) that you measure and observe. Independent variables as discussed here are simply the tuning elements that you have chosen for your test.

Variable

The word variable (when used by itself) means a tuning element that you have selected. Variables can be of any granularity or coarseness. For example, a variable might be the headline of your landing page, or a whole-page redesign. In multivariate testing, a variable is also commonly referred to as a factor.

In a multivariate test, you will have more than one variable. To distinguish among them I use the following notation: a capital “V” followed by a unique number that has been assigned to a particular variable. For example, let’s assume that you have a simple landing page with a headline, some sales copy test, and a call-to-action on a button, You might decide to test alternatives to each of these page elements and name them as follows:

• V1 = Headline
• V2 = Sales copy
• V3 = Button text
• V4 = Button color

Note that the variables do not necessarily define a unique physical location on the page. In fact, V3 (the button text) and V4 (the button color) actually occupy the same space. Nor do they have to be localized. For example, I can choose a variable to test a larger font size (for improved readability) versus an existing smaller one. In this case, the font size change would take effect throughout my whole landing page and would overlap with other variables (such as the actual text on the page) that I might also be testing.

Value

A value is a particular state that a variable can take on. When traditional multivariate testing is used in other fields, variable values are often continuous (which means they can vary smoothly across a range). This allows you to predict the behavior at interpolated values of the variable (in between the places where you actually sample). For example, if I know that the output of a car engine at 1000 RPM (revolutions-per-minute) is 100 horsepower, and at 2000 RPM is 200 horsepower, I can interpolate between these two values to estimate that the output should be 150 horsepower at 1500 RPM.

In landing page tuning, variable values are almost always discrete (distinct from each other, and countable). For example, a button color might be green, blue, or red. I will number the possible choices by successive lowercase letters. By convention, the letter a represents the original version of the variable (as seen on your baseline pretest landing page). The letter is combined with the variable name to exactly specify the value of a particular variable. If V4 is our button color, an example assignment might look as follows:

• V4a = green button (the original)
• V4b = blue button
• V4c = red button

Unlike continuous variables, measuring the effect of discrete variable values does not give us any information about the other possible values. Continuing our example from earlier, even if we had measured the average conversion rates with the green and blue buttons, we would not have any information about the performance of the red one.

Branching Factor

The total number of possible values for a discrete variable is called its branching factor. For discrete variables, the branching factor must be at least 2 (the original version and one alternative). Some experimental designs require that the branching factor be the same for all variables in the test.

In the button color example, V4 has a branching factor of 3 (because it can take on the values signified by a-green, b-blue, and c-red). In traditional multivariate testing, the number of values for a variable is called the level of the factor. Each value is also called a level because historically it was drawn from continuous variables. For example, if your variable only has two values, they might be signified by “low” and “high” (or “-1” and “+1”).

Recipe

A recipe is a unique combination of variable values in your test. It is a sequential listing of the specific values that each variable takes on in the specific version of the landing page. For example, let’s assume that you had set the following variable values from my previous example for a particular landing page in your test: V1b, V2c, V3a, V4a. The recipe could be abbreviated as bcaa.

Each recipe is unique. By convention, the recipe with all a’s is the original or baseline recipe to which all others will be compared.

Search Space Size

The number of unique recipes in your test is your search space size. It can generally be computed by multiplying together all of the branching factors of the variables in your test (for a possible exception to this rule, please see the next section, “Test Construction”).

In my earlier example, let’s assume that there are three headlines, four versions of the sales copy, four calls-to-action, and three button colors (and “BF” stands for the branching factor for a particular variable).

Search space size
= BFV1 X BFV2 X BFV3 X BFV4
= 3 X 4 X 4 X 3
= 144

This example is a small one. As you can see, if you have more variables and higher branching factors for each one, the search space size will grow very rapidly. If the search space size is large, it can quickly exceed the practical limits of common tuning methods such as A-B split testing, fractional factorial parametric, and full factorial parametric testing.
Now that you understand the basic terminology of landing page testing you can begin to think about which items to test and how to construct your test.

All About Conversion - Conversion Conference ($250 Discount!)

Pete Prestipino — Thu, 24 Feb 2011 23:00:00 GMT

Just a quick note for the Website Magazine community - particularly for fans of the Conversion Cache column in Website Magazine written by Tim Ash.

The upcoming Conversion Conversion is fast approaching - March 14-15 in San Francisco.

If you're interesting in learning how to make your website and its landing pages produce more conversions, this is most definitely the conference for you. This is a unique event with 20 education sessions, live website critiques, roundtable lunches with speakers and one of the best keynote lineups I've seen including Tim Ash (WM columnist and author of Landing Page Optimziation), Bryan Eisenberg, Thomas Davenport and Michael Summers.

If that weren't enough, you will also have the opportunity to hob-knob with other attendees - many of whom are from very high profile companies including eBay, GoDaddy, MAttel, Google, Adobe, CareerBuilder, Orbitz, Kohls and others.

Website Magazine Discount for Conversion Conference:
One last thing - use Promo code WM15 during registration and you'll automatically receive $250 off the registration price. Pretty sweet, right? Tell them Website Magazine sent you!

Conversion Conference - It's all about the conversion

Pete Prestipino — Thu, 01 Apr 2010 19:40:00 GMT

If you're interested in getting more leads and sales from the visitor traffic you are receiving (and who isn't?) you need to focus on conversion. An excellent way to jumpstart that process is to attend Conversion Conference, an event dedicated to helping marketers master conversion and learn from the industry's leading authorities. I spoke with conference organizer, landing page optimization expert and Website Magazine contributor Tim Ash about the upcoming conference.

If you're interested in attending Conversion Conference, the early bird deadline is April 15th. Save $100 and use promo code "CCW549" during registration.

- What is Conversion Conference and why did you create it?
Conversion Conference is an ongoing conference series focused exclusively on increasing online conversion rates. Until we organized the conference, conversion was simply a side topic at other events. I always felt that this was a bit backward - having an efficient landing page or website should be at the core of online marketing activities. I am thrilled that conversion now has a home! The event is co-located with the established eMetrics Marketing Optimization Summit and will be in San Jose May 4-5th, and Washington D.C. October 5-6th. The German Conference in Hamburg in late October is also the first of several planned international events.

- Tell Website Magazine Readers about what they can expect from attending Conversion Conference.
We have two full days with 26 sessions and three terrific keynotes by myself, and the superstars of Web usability Bryan Eisenberg and Jakob Nielsen. The sessions are all very practical with a lot of actionable takeaways. There will be birds-of-a-feather seating during lunch as well as networking mixers at the close of each day. The expo hall will feature the leading companies in online marketing automation and services and is open for free for people who pre-register for an expo-only pass. On the evening of May 4th the fun-loving folks from WebmasterRadio.fm will produce the Conversion Bash party for all paid Conversion Conference and eMetrics attendees - guaranteed to be a great time!

- There are four conference "tracks" - which attendees should take what tracks and why?
There are two solid half-day afternoon workshops before the conference and four tracks: persuasion, hands-on, best-practices, and testing. The persuasion track focuses on copywriting, visual design, and the psychology of influencing people to act. The hands-on track will feature live landing page critiques, and the ability to ask your questions directly during expert open-mic panels. The best-practices track offers a wide variety of specialized conversion applications ranging from SEO, PPC, e-mail, mobile, e-commerce catalogs, and lead generation. The testing track is designed for people who want to conduct landing page optimization tests and covers split testing basics, and advanced topics like multivariate testing and personalization of content.

- If you had to choose a few "can't miss" sessions, what would they be?
That's a tough question. I have had the luxury of picking from a deep field of very knowledgeable people as speakers and they are all very solid. I think that you should construct your experience of the conference by picking by the topics that interest you - you will not be disappointed with any of the sessions.

Landing Page Optimization: Guaranteed ROI

Pete Prestipino — Tue, 19 Aug 2008 18:15:00 GMT

Today at Search Engine Strategies in San Jose, SiteTuners is “putting its money where its mouth is” by offering the web marketing industry’s only “Guaranteed ROI” pricing plan for landing page optimization tests guaranteeing customers will make money.

SiteTuners’ “Fixed Price with Guaranteed ROI” pricing plan sets a fixed price for landing page testing and guarantees a minimum 5 percent improvement over the original landing page tested. However, if SiteTuners does not improve the conversion rate during its landing page optimization by the 5 percent, it will pro-rate its fees and return a portion to the company. If SiteTuners cannot document any conversion improvement, companies pay nothing.

“Most competitors typically charge high fees or retainers – and do not give any guarantees. That works out well for the testing company, but can leave the client in the lurch,” said Tim Ash, president of SiteTuners. “We are confident in our ability to deliver results, and are the only major landing page optimization company to offer this Guaranteed ROI - allowing companies to make higher profits with zero financial risk.”

SiteTuners has a very strong track record of significant landing page conversion rate improvements and has worked with companies such as Red Envelope, 1-800-Flowers, Verizon Wireless, American Red Cross, Rand McNally, Advanta, McAfee, Black & Decker, Fair Isaac, and Texas Instruments. SiteTuners offers a full range of services including conversion consulting, landing page optimization, and self service landing page testing tools.

Previous coverage of SiteTuners and articles contributed by Tim Ash, President of SiteTuners: