Friday, May 13, 2016

Love Your Outliers

Go Right, Young Marketer
Today in the column, I'm going to do something odd: direct you to a long-form piece that has nothing to do with marketing and advertising. So go read about "The Lazarus Effect" in the New York Times Magazine, then come on back. (Oh, and if you refuse to click, the story covers what cancer researchers use to refer to the phenomenon of a drug having an unexpectedly great outcome for a patient, which isn't predicted based on past performance in the sample group. That's where the phrase of "extraordinary responders" comes in. It turns out that part of the massive undertaking in curing cancer is that each person's fight has aspects of unique genetic coding, and we just don't know enough yet, but are learning more than we ever have before, partly through, well, studying the outliers. This isn't meant to give false hope for a cure, because the awful nature of cancer progression is that all of the great aspects of evolution are at work in reverse, but yeah, it's OK to be hopeful anyway.)

This week at my gig, a marketing program brought in a startlingly high response rate, about 2X more than predicted, for a very mature program. The amount was statistically significant, in a reporting system that's stable, and possibly explained due to creative and tactical choices. Needless to say, I'm thrilled by the performance, and staring it down to see if I can replicate it with other programs. But in and of itself, it's just one campaign, just one data point in an ever-growing sea of numbers, and might not be a breakthrough.

Now, the other side of the street. I also performed a post-mortem on a challenged campaign, where the client tried something very different from our usual practices, and wound up producing numbers that were substantially below our medians. A co-worker who is new to this sort of analysis called the result terrible, and while I don't disagree, I had to bring in my perspective... which is that no data is terrible, especially because we didn't know what metrics the client was anticipating. While the set of numbers we got in this instance looked like underperformance, we will only really know that later, once these metrics prove out as ordinary, or give us an outlier.

So if your marketing programs are delivering consistency and certainty and a narrow performance array, shake it up. Push your levers, either creative or tactical, more to the margins (in, of course, a test cell). Even if this means that you leave some money on the table from something that you'll later think "Well, of course that didn't work," it's still got crazy value, because it puts a number on the practice, and lets you counsel clients later away from trouble.

Because if you are in this for the long-term benefit of your client and career, you quickly learn that the outliers drive the learning... and that any marketer or advertiser that isn't learning isn't, well, likely to make a career of this.

* * * * *

Feel free to comment, as well as like or share this column, connect with me on LinkedIn, or email me at davidlmountain at gmail dot com, or hit the RFP boxes at top right. RFPs are always free, and we hope to hear from you soon.

No comments:

Post a Comment