---
schema_version: "1"
id: c26ee03f1b9f1b3f8396a23b35f3ef410963995c415994fa1da920efc5e25363
title: Configure Model Quality Notifications
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/analytics/264-0-0/bi_edd_model_manager_notify.md
canonical_url: https://help.salesforce.com/s/articleView?id=analytics.bi_edd_model_manager_notify.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: 280cdd82a8b59534ac0694121ea603558d7c0b9ed502b7ff21a6d23b2334577c
description: Models drift when characteristics in the real world data diverge significantly from the training data used to build them. Einstein can send out alert notifications if your model performance falls below configured thresholds. Significant increases in prediction error rates, missing values, or out-of-bounds values can trigger notifications, as well as detected disparate impact among variables being analyzed for bias. You can set alert thresholds, schedule weekly or monthly performance evaluation cycles, and specify who will receive notifications.
products:
  - CRM Analytics
  - Cross Cloud
release: "264"
---
# Configure Model Quality Notifications

Models drift when characteristics in the real world data diverge significantly from the training data used to build them. Einstein can send out alert notifications if your model performance falls below configured thresholds. Significant increases in prediction error rates, missing values, or out-of-bounds values can trigger notifications, as well as detected disparate impact among variables being analyzed for bias. You can set alert thresholds, schedule weekly or monthly performance evaluation cycles, and specify who will receive notifications.

![Note](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-analytics-bi-264-0-0-production-enus/ec791473-f5b4-4f64-a656-9104f455d966/images/icon_note.png)

Note When you deploy a model version, Einstein resets performance statistics, begins accumulating performance statistics for the current model version, and clears history for previous versions.

To configure performance alerts:

1. In Model Manager, [View a Prediction Definition](https://help.salesforce.com/s/articleView?id=analytics.bi_edd_model_manager_view.htm&release=264.0.0&type=5 "Manage a prediction definition and its associated models.") that uses automated writeback fields.
2. In the settings panel, click **Set Up** next to **Model Quality Notifications**.
    
    ![Prediction definition overview, showing the notification button](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-analytics-bi-264-0-0-production-enus/ec791473-f5b4-4f64-a656-9104f455d966/bi/images/bi/bi_edd_model_manager_notify_changes.png)
3. Enable any of the alert conditions.
    
    ![Alert editing window, showing the available alert conditions](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-analytics-bi-264-0-0-production-enus/ec791473-f5b4-4f64-a656-9104f455d966/bi/images/bi/bi_edd_model_manager_notify_condition.png)
4. Configure the settings for enabled alert conditions.
    
    ![Alert editing window, showing the settings for the alert conditions](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-analytics-bi-264-0-0-production-enus/ec791473-f5b4-4f64-a656-9104f455d966/bi/images/bi/bi_edd_model_manager_notify_settings.png)
    
    <table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small ">
              <colgroup>
                <col style="width:20%">
                <col style="width:80%">
              </colgroup>
              <thead class="slds-text-title_caps ">
                <tr class="">
                  <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d121825e109">Condition</th>
                  <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d121825e112">Alert Threshold</th>
                </tr>
              </thead>
              <tbody>
                <tr class="">
                  <td data-label="Condition" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e109 ">
                    <strong class="uicontrol">Prediction accuracy decreases</strong>
                  </td>

                  <td data-label="Alert Threshold" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e112 ">
                    <div class="slds-box slds-box_x-small slds-theme_shade slds-m-top_medium slds-m-bottom_medium">
                      <div class="slds-media slds-media_responsive">
                        <div class="slds-media__figure"><span class="slds-icon_container slds-icon_container_circle slds-icon-note-note"><img style="margin-bottom:0;" src="https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-analytics-bi-264-0-0-production-enus/ec791473-f5b4-4f64-a656-9104f455d966/images/icon_note.png" alt="Note"></span></div>
                        <div class="slds-media__body" style="padding-top:.5rem;padding-bottom:.5rem;"><span class="slds-text-title_caps">Note</span> This option requires that your model's completed state is
                          configured to enable accuracy monitoring.</div>
                      </div>
                    </div>
                    <p style="margin-bottom:0;">Trigger a notification when
                      the true positive or true negative rate for live data falls below the training
                      data by the specified percentage.</p>
                  </td>

                </tr>
                <tr class="">
                  <td data-label="Condition" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e109 ">
                    <strong class="uicontrol">Too many missing values</strong>
                  </td>

                  <td data-label="Alert Threshold" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e112 ">Trigger a notification when the number of records with missing values
                    exceeds the specified percentage.</td>

                </tr>
                <tr class="">
                  <td data-label="Condition" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e109 ">
                    <strong class="uicontrol">Too many out-of-bounds values</strong>
                  </td>

                  <td data-label="Alert Threshold" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e112 ">Trigger a notification when the number of records with out-of-bounds
                    values exceeds the specified percentage. An out-of-bounds value is a value not
                    found in the training data used to train the model.</td>

                </tr>
                <tr class="">
                  <td data-label="Condition" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e109 ">
                    <strong class="uicontrol">Has disparate impact</strong>
                  </td>

                  <td data-label="Alert Threshold" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e112 ">
                    <p>Triggers a notification when an adverse ratio (below 80%) is detected in
                      live data among variables being analyzed for bias.</p>
                    <div style="text-align:left;"><img style="width:600px;" src="https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-analytics-bi-264-0-0-production-enus/ec791473-f5b4-4f64-a656-9104f455d966/bi/images/bi/bi_edd_model_manager_notify_disparateImpact.png" alt="Disparate impact alert"></div>
                    <p style="margin-bottom:0;">Open the alert to see a chart that displays the unequal distribution of
                      values or groups within the variable. The blue column shows the highest
                      selection rate, while the orange column shows the adversely impacted value
                      group.</p>
                  </td>

                </tr>
                <tr class="">
                  <td data-label="Condition" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e109 ">
                    <strong class="uicontrol">Notify recipients only the first time this condition is
                      reached</strong>
                  </td>

                  <td data-label="Alert Threshold" class="slds-cell-wrap" style="vertical-align:top;" headers="d121825e112 ">Enable if you don’t want subsequent notifications.</td>

                </tr>
              </tbody>
            </table>
5. For **Frequency**, configure how frequently to evaluate the model: **Weekly** or **Monthly**, and day of the week or month, and the start time.
6. For **Notification recipients**, click **Edit Recipients** and specify the email addresses of notification recipients.
    
    ![Settings to create a recipient list](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-analytics-bi-264-0-0-production-enus/ec791473-f5b4-4f64-a656-9104f455d966/bi/images/bi/bi_edd_model_manager_notify_recipients.png)
    
    - To add a user, select **Users** in the **Add to Recipients List**, click in the **User name** box, select a user, and click **Add**.
    
    - To add a group, select **Groups** in the **Add to Recipients List**, click in the **Group name** box, select a group, and click **Add**.
    
    To close this window, click the **X** in the upper right corner.
7. Click **Save**.

#### See Also

- [Handle Live Data Alerts](https://help.salesforce.com/s/articleView?id=analytics.bi_edd_model_manager_live_data_alert.htm&release=264.0.0&type=5 "Live data monitoring detects when your production data contains high levels of missing or out-of-bounds values—indications that your model’s accuracy is declining. Model Manager surfaces alerts so that you can easily see what’s happening in your data.")