Using A/B Testing to Determine the Best Marketing Channel

Last week, Fire Enterprises, Inc. (FEI) marketing whiz Marka gave head honcho Org and savvy salesperson Zoot tips for putting FEI’s “Why” message to use in marketing communications. This week, Marka discusses how doing A/B testing in different marketing channels can help FEI determine which is most effective. Remember, fire = print.

Marka walked into Org’s office one morning. Org looked up from his work. “What’s up, Marka?” he asked.

“I’m concerned about FEI’s broadcast O-mail marketing efforts,” Marka said. “Over the past three months, our open and click-through rates have declined to historic lows. It’s been several months since we’ve gotten any new clients from O-mail.”

“That is a problem,” Org agreed. “What’s the solution?”

“Let’s compare O-mail with different marketing channels to see which works best,” Marka said. “We can run an A/B test campaign that compares broadcast O-mail and direct mail. The offer, list and creative elements will be identical in both communications. The only element that will change, obviously, will be the delivery channel.”

“How exactly will we measure which channel performs best?” Org asked.

“We’ll create distinct, trackable landing pages for both the O-mail and postcard campaigns that will allow us to see how many recipients respond, and how many take a desired final action,” Marka explained.

“Impressive,” Org said. “I approve this idea. I look forward to seeing how it turns out.”

Marka and her marketing tribe put together an identical O-mail and postcard promoting FEI’s newly launched MatchTastic match. After both campaigns had concluded, Marka compiled the results and presented them to the tribe at the weekly marketing meeting.

Response Rate 4.3% 2.9%
Cost per Response (in Drachmas) 30 78

“Despite having a higher total cost, the postcard campaign resulted in a lower cost per response—i.e., visiting the initial landing page on FEI’s O-site—by a wide margin,” Marka pointed out.

T.J. is team leader of Grow Sales, Inc., a marketing and social media services company operating at the intersection of compelling content, clear vision and quality communication practices. In this blog, fire is a metaphor for print. Hang on, this ride will be weird...Prometheus crept into Mt. Olympus, stole fire, returned to the lowlands, ran from house to house distributing it, got caught, was chained to a rock, lost his liver to a huge ugly bird and was rescued by Hercules. Leveraging his fame, Prometheus started Fire Enterprises Inc.  (FEI). Since fire was the hottest technology of the time, company success came fast and furious. Two generations later, fire isn't such an easy sale. Now led by Prometheus' grandson Org, FEI's growth is non-existent, competitors are pounding and prices are in the toilet.
Related Content