---
schema_version: "1"
id: e39fc2c64af70d7f195ecda1b240a78c702d98ec55de875bc8a0da748c352921
title: Configure an A/B Test to Compare Promotions
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/cc/264-0-0/b2c_ab_test_comparing_promotions.md
canonical_url: https://help.salesforce.com/s/articleView?id=cc.b2c_ab_test_comparing_promotions.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: 5b88625e046a4e4655e4440974d5a4a70e94f8f499bf0aa11fe7fb4bdb9e4b55
description: Review which promotions perform the best against a control group, compare them by using A/B tests.
products:
  - Commerce
  - B2C Commerce
release: "264"
---
# Configure an A/B Test to Compare Promotions

Review which promotions perform the best against a control group, compare them by using A/B tests.

Compare three promotions for a new campaign:

- Free shipping on orders over $100.
- 10% off orders over $100.
- $25 off orders over $200.

1. From App Launcher ![App Launcher](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-cc-b2c_merchandiser_administrator-264-0-0-production-enus/ea76f372-6cfa-42a6-8e7c-05c6df7abed8/cc/b2c_merchandiser_administrator/images/appLauncher.png) select **Merchant Tools**.
2. Expand **Online Marketing** | **Promotions**.
3. Make sure that the three promotions exist. Add any that are missing.
4. Select **A/B Tests**, and create a test with the ID Content Promotion Test.
    1. Enable the test and enter an optional description that is for usage in the testing.
    2. Include an email address for a notification when there are statistically significant results for the key metric.
    3. Select **Orders** as the key metric, but consider other metrics when looking at the results.
        
        The test is looking for the promotion that leads to the highest `Conversion Rate`. The test is also looking for the one that maximizes `Average Order Value` and minimizes the `Average Discount Amount.`
5. Select per customer or per browser to provide more control.
    
    If customers return to the site in a repeat visit during the test, you want to offer them the same promotion.
    
    - Per customer tracks in the customer profile, so anytime the customer is recognized they participate in the same test segment.
    - Per browser tracks similarly to per customer except the participation is connected to the browser history and cookies.
6. Configure the test to include participants from the Everyone group, so that all customers can participate.
7. Set up three test segments.
    
    - Free Shipping over 100 allocated 30%
    - 10% off 100 allocated 30%
    - $25 off 200 allocated 30%
    
    ![Note](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-cc-b2c_merchandiser_administrator-264-0-0-production-enus/ea76f372-6cfa-42a6-8e7c-05c6df7abed8/images/icon_note.png)
    
    Note Business Manager automatically allocates the remaining 10% to the control group.
8. Select **Content Slots** and identify the slot Header Banner on the site.
9. Show a banner for each included promotion, and create three slot configurations for, each with the content for one of the three promotions.
10. Return to the test and include the corresponding slot configuration as an experience for each test group, in addition to the control.
11. Set the test start date to midnight and the end date to 9PM Saturday.
    
    You want an answer before the summer clearance begins next Monday.
12. After creating the test on staging, replicate it to production.
    
    The test goes into effect at midnight, and you receive an email alert when there are results.
13. Review the results page.
    
    - Orders. The Free Shipping over $100 segment shows a statistically significant difference in Order Rate at 5%. The other segments show a roughly equal Order Rate of 4%.
    - Average Order Value. The $25 off $200 segment has a statistically significant difference at $59.50. The other segments show a roughly equal Average Order Value around $47.
    - Average Revenue per Visit. The Free Shipping over 100 segment is higher, but the difference isn't statistically significant.

You conclude that the Free shipping over $100 and $25 off $200 promotions perform better than the control group. Use these two promotions for your site.