- Buying a home purifier is complicated. So many technical details. So much to consider. This is your family’s health after all. It’s an $899 unit, worth every penny, but still, it’s $899.
- Recognize that some users like detailed descriptions, others don’t.
- People aren’t here to look at pretty pictures. They want to read. Make reading easy.
- Improved product sales 30.56%.
Not enough attention is paid to product descriptions. Once written, it’s seldom tested.
Also, we assume no one will read long detailed content. We’ve seen a trend where e-tailers have significantly trimmed down their product descriptions. Last week I saw a product page with just 2 sentences in their product description. Now that’s crazy.
Reality: some of us are methodical (we’ll read a 2,000 word essay if the content is solid) and others just want the summarized version of the story.
Marketing teams debate hard, consider all shopper types, and make a decision about content length. The person missing from this marketing meeting is your actual shopper, the person pulling out their credit card.
Our thesis was that some people who land on this EJ120 page will have time and want to read all the technical specs (MERV17 rating, quiet German motor tech, 0.3 micron filtering). Riveting for some.
Others wouldn’t have a lot of time and would just want the most important details.
We like to gamble but we don’t bet the farm on one idea, so we created 4 treatments.
This case study is about Variation 4.
Visitors to Variation 4 saw this in the main description area of the page (see 2 orange buttons below):
1: In the original page the background color was a slightly darker shade of grey. But the foreground text is also in grey. Since our entire idea hinged on people reading our persuasive copy we wanted to ensure it was readable. So we lightened the background to make the text pop more.
2: We added a persuasive headline:
No other air purifier does so much, this quietly.
And we’ve tested them all.
This isn’t just any headline, it’s developed based on our copywriting playbook. The idea is to let users know they don’t have to worry testing other air purifiers, we’ve tested all for them.
3: Perhaps the most important change we made was adding this question: How much time do you have?
Now, instead of guessing what type of reader was on this we let them pick. Why doesn’t this exist? So simple, yet we’ve never seen this before.
People who clicked [I have 2 minutes] were shown the quick elevator pitch. The word count might have been cut but we made sure every word counted.
People who clicked [I have time], well, we showed them everything. Incredible detail.
We tracked this test closely, it was, after all, a radical change. Variation 4 (above) performed significantly better than control every single week.
Test ran for 4 weeks. You can see all 4 Variations did well but Variation 4 was at highest confidence level:
Now, VWO (our A/B testing solution) is looking at overall impact. What we really want to understand is how EJ120 unit sales went up.
So we connected VWO data with Google Analytics and looked at the raw numbers and ran it through a statistical calculator. Turns out, unique unit sales of EJ120 were up 30.56%. Statistical significance of 98.51%.