---
schema_version: "1"
id: 5589e57d962823519b9ec6fd43546eb81b7697b3734f42c12e6a76cc1601fd68
title: Retriever Metrics and Results
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/data/264-0-0/c360_a_ai_retriever_test_metrics.md
canonical_url: https://help.salesforce.com/s/articleView?id=data.c360_a_ai_retriever_test_metrics.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: 1fee084bbf5dc8e5d414513d9f02bc2274fb36b312992ecdd3f61587a3cef01c
description: Review retriever metrics and the retrieved data chunks to understand the results of your test. Modify the retriever configuration to try different configurations and expected source data to get an optimal response. Save your configuration as a new version of the retriever.
products:
  - Data 360
release: "264"
---
# Retriever Metrics and Results

Review retriever metrics and the retrieved data chunks to understand the results of your test. Modify the retriever configuration to try different configurations and expected source data to get an optimal response. Save your configuration as a new version of the retriever.

## Retriever Metrics

You can test a retriever in a basic mode and an advanced mode. When you test a retriever in the advanced mode, the retriever playground generates a context recall score and a context precision score based on a reference answer. Testing retrievers in the advanced mode consumes flex credits.

**Retriever Playground in Basic Test Mode**

![The image shows a retriever playground in the basic test mode and a sample configuration for a retriever. The test retriever panel shows a sample test question. The retriever results panel is empty .](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-data-data_cloud-264-0-0-production-enus/f3569962-3c9b-4f83-9d0c-b6a574e785da/data_cloud/images/retrievers-adv-mode.png)

![The image shows a retriever playground where the user has entered a sample test question. There are two expected source data records selected. The retriever metrics panel shows a source recall score, response time and retrieved chunks metrics.](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-data-data_cloud-264-0-0-production-enus/f3569962-3c9b-4f83-9d0c-b6a574e785da/data_cloud/images/retriever-adv-metrics.png)

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small ">
        <colgroup>
          <col style="width:33.33333333333333%">
          <col style="width:33.33333333333333%">
          <col style="width:33.33333333333333%">
        </colgroup>
        <thead class="slds-text-title_caps ">
          <tr class="">
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d51586e67">Metric</th>
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d51586e70">Description</th>
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d51586e73">More Details</th>
          </tr>
        </thead>
        <tbody>
          <tr class="">
            <td data-label="Metric" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e67 ">Source Recall Score</td>

            <td data-label="Description" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e70 ">Measures the percentage of expected source data chunks that are part of the top
              retrieved chunks over the total number of chunks in the expected source
              data.</td>

            <td data-label="More Details" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e73 ">
              <p>If the Source Recall Score is zero, retrieved chunks don't include chunks from
                the expected source data. </p>
              <p style="margin-bottom:0;">The score decreases when the number of expected source data chunks is high, even
                when there are common chunks between retrieved chunks and the expected source data
                chunks.</p>
            </td>

          </tr>
          <tr class="">
            <td data-label="Metric" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e67 ">Response Time</td>

            <td data-label="Description" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e70 ">The time in milliseconds for the retriever to respond with results.</td>

            <td data-label="More Details" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e73 ">-</td>

          </tr>
          <tr class="">
            <td data-label="Metric" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e67 ">Context Recall</td>

            <td data-label="Description" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e70 ">Available only in Advanced mode. Measures how many of the relevant documents
              were successfully retrieved based on a reference answer.</td>

            <td data-label="More Details" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e73 ">Higher recall means fewer relevant documents were missed. For more information
              see, Ragas <a href="https://docs.ragas.io/en/stable/concepts/metrics/available_metrics/context_recall/" target="_blank"><u>Context Recall</u></a></td>

          </tr>
          <tr class="">
            <td data-label="Metric" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e67 ">Context Precision</td>

            <td data-label="Description" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e70 ">Available only in Advanced mode. Measures the retriever’s ability to rank
              relevant chunks higher than irrelevant ones for a given query based on a reference
              answer.</td>

            <td data-label="More Details" class="slds-cell-wrap" style="vertical-align:top;" headers="d51586e73 ">Higher precision score means the relevant chunks in the retrieved context are
              placed at top of the ranking. For more information see, Ragas <a href="https://docs.ragas.io/en/stable/concepts/metrics/available_metrics/context_precision/" target="_blank"><u>Context Precision</u></a>.</td>

          </tr>
        </tbody>
      </table>

## Retrieved Chunks Metrics

Review the quality of your retriever response with the data in the Retrieved Chunks table or card view. Compare the overlap between the chunks selected by the retriever to the expected source data chunks to check if the top scoring chunks are from the expected source data.

 
| Metric | Description |
| --- | --- |
| \# Expected Chunks | Determines the maximum number of expected source data chunks to show in the tables. |
| All Chunks | The table shows data on all retrieved chunks - chunks in the expected source data, chunks selected by the retriever, chunk score, and source record for the chunk. Additionally, the table shows any fields the retriever returns. |
| Selected by Retriever | The table shows filtered column data on the chunks that the retriever selects. |
| Expected Source | The table shows filtered column data on chunks from the expected source. |
| Chunks | All retrieved chunks. |
| Chunk Score | Score value for the chunk that determines relevance ranking. There are many factors that affect chunk scores such as the query text, embedding model etc. |
| Citations | Links to the source content relevant to the retrieved chunk. Verify the validity of the source to ensure trusted responses when you deploy the retriever. |