An A/B test configuration requires you to specify the key metric, which is the most important measurement among the metrics collected from test participant activity.
B2C Commerce A/B testing collects the following metrics:
| Metric | Description |
|---|---|
| Baskets | Number of sessions where one or more products were added to the basket |
| Basket Rate | Baskets per visit |
| Adds to Baskets | Number of products added to the basket |
| Average Adds per Basket | Average number of products added per basket |
| Units Added to Baskets | Number of product units added to the basket |
| Average Units Added per Basket | Average number of units added per basket |
| Checkouts | Number of checkouts started. Add the StartCheckout pipelet to the checkout pipeline to capture the checkout metrics. Otherwise, they remain at 0. |
| Checkout Rate* | Checkouts per visit |
| Orders | Number of orders placed |
| Conversion Rate | Orders per visit |
| Units | Number of units in placed orders |
| Average Units per Order | Average number of units in placed orders |
| Revenue | Revenue of placed orders |
| Average Revenue per Visit | Average revenue of placed orders per visit |
| Average Order Value | Average amount of revenue per placed order in site currency |
| Sales Velocity | Units per test length in hours |
| Total Discount Amount | Total amount of promotion discounts applied in placed orders |
| Discount Amount with Coupon | Total amount of coupon promotion discounts in placed orders |
| Average Discount Amount with Coupon | Average amount of coupon promotion discounts applied per placed order |
| Discount Amount without Coupon | Total amount of non-coupon promotion discounts in placed orders |
| Average Discount Amount without Coupon | Average amount of non-coupon promotion discounts applied per placed order |
When a site supports multiple currencies, B2C Commerce collects raw data values across all sessions, regardless of session currency. B2C Commerce converts currency values into the site's default currency. If a shopper places an order during an A/B test, A/B test statistics reflect the converted monetary value.
B2C Commerce updates A/B testing metrics within 10 minutes on a Production instance. On Staging instances, B2C Commerce updates metrics daily overnight. This setting is not configurable.