Salesforce Docs Portal

Configure A/B Tests for Multiple Segments and Slots

Determine how the order of two recommended products, and the home page background image affects Adds to Basket. Test changes to the order of four recommended products and the background image for a home page slot. There's a limited time to perform the test and you can't run the tests one after the other.

Complete these tasks in the Staging instance.

  1. Click App Launcher App Launcher, selects Merchant Tools, and then goes to Online Marketing | A/B Tests, and creates an A/B test called recommended-products.
  2. Enable the test and enter an optional description.
  3. Include an email address for notifications when there are statistically significant results for the key metric.
  4. Select Adds to Baskets as the key metric.
  5. Configure the test to:
    • Expire along with sessions.
    • Run for 1 week.
    • Be available for the Everyone customer group.
  6. Create four segments plus a control group and allocate 20% of the participants to each.
  7. Go to Online Marketing | Content Slots.
  8. Under Global Slots, create four slot configurations, one for each order of recommended products and background image.
    ID Content Type Content Template
    bgImage-1 Content Asset Image-1 slots/product/verticalcarousel.isml
    bgImage-2 Content Asset Image-1 slots/product/verticalcarousel.isml
    Product-1 Product product1, product2, product3, product4 slots/product/verticalcarousel.isml
    Product-2 Product product1, product2, product3, product4 slots/product/verticalcarousel.isml
  9. Return to the test and assign the corresponding slot configurations to the test segments. Each segment has the image applying first and the product order second.
    Segment ID Content Asset Slot Product Slot
    recommended-products-1 bgImage-1 Product-1
    recommended-products-2 bgImage-1 Product-2
    recommended-products-3 bgImage-2 Product-1
    recommended-products-4 bgImage-2 Product-2
  10. Replicate the test to production and run it for the week.
    • One recommended order of products leads to more Adds to Baskets than the other.
    • One background image leads to more Adds to Baskets than the other.

The combination of the better product order and background image shows a statistically significant difference in Adds to Baskets over the other combinations. Use the most effective combination for an upcoming change to the homepage slot content.