Configure an A/B Test to Compare Content Slots

Determine which creative content on a content slot performs the best.

  1. From App Launcher App Launcher select Merchant Tools.
  2. Go to Online Marketing | A/B Test.
  3. Create a test with ID Creative-Test-1.
  4. Enable the test and enter an optional description of it.
  5. Set the metric to Checkout Rate.
    The site is losing customers during the checkout process. The goal is to eliminate that as a variable, though the impact that creative pieces have on conversion rate isn’t clear.
  6. Set participation to expire per session.
    The same customer can see different content in different visits. The customer enters a test group again when they return.
  7. Configure the test to run all day the coming Monday through Wednesday.
  8. Configure the test for Registered Customers.
  9. Create two test groups, each with 40% allocation, leaving 20% for the control group.
  10. Select Content Slots.
    There are now two slot configurations, one for each content asset representing each creative set of creative content.
  11. Return to the test and include the corresponding slot configuration for each test group, in addition to the control group.
    After the test runs several days, one shows a higher Average Discount Amount With Coupon metric, but the other shows a higher Checkout Rate, the key metric.

The metric Average Discount Amount With Coupon is higher because it includes a coupon code, while the other doesn't. Based on these findings and the impact during checkout, the marketing department moves forward with a site-wide creative effort based on the winning piece.