---
schema_version: "1"
id: c21ea401e7f9042ef0e4ad230fe4ab64d9c08425ba7c548537d7b85c471dba24
title: Test Multiple Intent Predictions
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/service/264-0-0/bots_service_intent_predictions_bulk.md
canonical_url: https://help.salesforce.com/s/articleView?id=service.bots_service_intent_predictions_bulk.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: cd476a8bffa2a3e0c9177575effe827ba4c2417effcefab563ca99d3b62b70bd
description: Evaluate how accurately your bot predicts intents by testing multiple utterances in bulk instead of one at a time. This method helps assess intent accuracy and identify gaps in intent configuration. Bulk testing helps identify misclassified utterances and assess overall model performance by using prediction metrics. Previously, testing utterances required manual, one-by-one validation. Bulk testing streamlines the process by analyzing large datasets and returning a consolidated prediction summary.
products:
  - Service Cloud
  - Service Intelligence
release: "264"
---
# Test Multiple Intent Predictions

Evaluate how accurately your bot predicts intents by testing multiple utterances in bulk instead of one at a time. This method helps assess intent accuracy and identify gaps in intent configuration. Bulk testing helps identify misclassified utterances and assess overall model performance by using prediction metrics. Previously, testing utterances required manual, one-by-one validation. Bulk testing streamlines the process by analyzing large datasets and returning a consolidated prediction summary.

### Required Editions

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small edition"><colgroup><col></colgroup><tbody><tr class=""><td class="slds-cell-wrap" style="vertical-align:top;"><a href="https://help.salesforce.com/s/articleView?id=service.einstein_service_intro.htm&amp;language=en_US" target="_blank">View supported editions</a>.</td></tr></tbody></table>

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small permission">
        <colgroup>
          <col style="width:50%">
          <col style="width:50%">
        </colgroup>
        <thead class="slds-text-title_caps ">
          <tr class="">
            <th scope="colgroup" class="slds-cell-wrap" colspan="2" style="text-align:center;vertical-align:top;" id="d94127e57">User Permissions Needed</th>
          </tr>
        </thead>
        <tbody>
          <tr class="">
            <td data-label="User Permissions Needed" class="slds-cell-wrap" style="vertical-align:top;" headers="d94127e57 ">To build and manage Einstein Bots:</td>

            <td class="slds-cell-wrap" style="vertical-align:top;" headers="d94127e57 ">
              <p>Customize Application</p>
              <p>OR</p>
              <p>Modify Metadata</p>
              <p>OR</p>
              <p style="margin-bottom:0;">Manage Bots</p>
            </td>

          </tr>
        </tbody>
      </table>

Use bulk testing to:

- Evaluate up to 1000 utterances in a single request
- Compare expected and predicted intents
- Review confidence scores for each prediction
- Analyze overall performance by using summary metrics

You can perform bulk testing in two ways:

- Test Custom Utterances: Provide a dataset of utterances and expected intents to evaluate specific scenarios.
- Test Using Existing Bot Data: Evaluate all utterances already configured in the bot to generate a complete performance summary.

These two approaches correspond to different API endpoints.

Before you begin, turn on Einstein Bots and Einstein for Intents, and build your model. Turn on the Batch Input Tester pilot permission, and turn on the cross-lingual intent model (Intent V3) on the Bot Overview page.

![Note](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-service-support_intelligence-264-0-0-production-enus/dcd06a7b-b5ab-448b-a767-4e2e90481508/images/icon_note.png)

Note Contact Salesforce Customer Support to turn on the Batch Input Tester pilot permission. If you turn off the cross-lingual intent model, Salesforce builds your model using Intent Standard V2 (for single languages) or Intent Multi-Language 2.5 (for multiple languages).

## How Bulk Testing Works

Bulk testing evaluates utterances against your bot's intent model and returns:

- You initiate an evaluation request with a set of utterances or a selected bot version.
- The intent model processes each utterance and predicts the most relevant intent.
- The system compares the predicted intent with the expected intent, when provided.
- The system assigns a confidence score and rating to each prediction.
- The system generates a prediction summary with overall performance metrics.
- The system returns consolidated results for all evaluated utterances.

## Understand Prediction Results

To understand how accurately the bot classifies utterances and to identify areas for improvement, review the prediction results.

Per-Utterance Results. For each utterance, the system returns:

- Predicted intent: The intent identified by the model
- Prediction outcome: Indicates whether the predicted intent matches the expected intent (pass, fail, or unprocessed)
- Confidence score: Indicates how likely the prediction is correct

Summary Metrics. The system provides aggregated metrics to help assess overall performance:

- Success rate: Percentage of utterances predicted correctly
- Fail count: Number of utterances predicted incorrectly
- Intent coverage rate: Percentage of intents correctly predicted for at least one utterance
- Error count: Number of utterances that the bot couldn't process

## Considerations

Keep these considerations in mind when you use bulk testing:

- You can evaluate a maximum of 1000 utterances at a time.
- Results depend on the quality of intent training data.
- Review failed predictions to improve intent accuracy.
- Errors for individual utterances don't stop the overall evaluation.

For API details, see [Bot Utterance Intent Prediction Resources](https://developer.salesforce.com/docs/atlas.en-us.chatterapi.meta/chatterapi/connect_resources_bots_utterance_prediction_resources.htm) in the _Connect REST API Developer Guide_.