--- schema_version: "1" id: 784eeb93981913ddfa0d6a619e48a222a65769c6d7fd0ccd80e0059842546093 title: Customize, Test, and Validate Retrievers with Retriever Playground collection: admin version: current locale: en-us portal_url: https://docs.salesforce.com/admin/current/en-us/data/264-0-0/c360_a_ai_retriever_test.md canonical_url: https://help.salesforce.com/s/articleView?id=data.c360_a_ai_retriever_test.htm&release=264.0.0&type=5 source_site: help.salesforce.com content_type: documentation content_hash: 46db25655d5924a60b1e88047fb76584bee4ed85ce57db6812ff391628f1bf05 description: Fine-tune and validate retrieval logic for retrieval-augmented generation (RAG) systems by using retriever playground, reducing deployment risks, and verifying accurate AI outputs. Use AI Models (formerly Einstein Studio) retriever playground to configure pre-filters, select test data, and adjust result parameters to customize retrieval logic for domain-specific use cases, such as retrieving complaince documents or knowledge articles. products: - Data 360 release: "264" --- # Customize, Test, and Validate Retrievers with Retriever Playground Fine-tune and validate retrieval logic for retrieval-augmented generation (RAG) systems by using retriever playground, reducing deployment risks, and verifying accurate AI outputs. Use AI Models (formerly Einstein Studio) retriever playground to configure pre-filters, select test data, and adjust result parameters to customize retrieval logic for domain-specific use cases, such as retrieving complaince documents or knowledge articles. ### Required Editions
Available in: All Editions supported by Data 360. See Data 360 edition availability.
Review intermediate outputs and key metrics, such as the Source Recall Score or Context Recall Score, to validate that the retriever finds information from expected source documents. Fine-tuning retrieval logic in the retriever playground is a cost-effective way to test and debug retrievers. Retriever playground improves agent performance and search relevance, establishing reliable and meaningful generative AI outcomes. ## Use Case: Agent Answers Field Service Questions on Installing Double Door Refrigerators with Incomplete Results A business administrator sets up an agent to respond to questions from contractors in the field who install their company refrigerators. Problem: Although the company knowledge base includes an article with complete step-by-step installation instructions, the field service provides feedback that responses from the agent are incomplete. The business admin tests the retriever set up for the agent in the retriever playground. The test shows that only five steps are retrieved from the eleven-step article. In reviewing the retriever results panel, the admin notices that the search index splits the article into two chunks. The top chunk includes the "double-door refrigerator" keyword. Because the second chunk dosen't include the necessary keywords from the question, it's scored lower in the result set and doesn't appear in the response. Solution: The admin increases the number of test results to include the chunk that contains the rest of the instructions. Then, the admin can test the new configuration with sample questions about installing double-door refrigerators to make sure that the response is complete. - **[Test an Individual Retriever](https://help.salesforce.com/s/articleView?id=data.c360_a_ai_retriever_test_create.htm&release=264.0.0&type=5)** Test a retriever configuration to ensure accurate responses from your AI agents. Save retriever configurations as new versions of the retriever in AI Models (formerly Einstein Studio). Activate them for use in agents with prompt templates, Flow, and apps. - **[Test an Ensemble Retriever](https://help.salesforce.com/s/articleView?id=data.c360_a_ai_retriever_test_ensemble.htm&release=264.0.0&type=5)** Test an ensemble retriever configuration in the AI Models retriever playground before you use it in prompt templates or AI agents. Add or remove retrievers to an ensemble, configure test data, and result parameters to verify the retrieval logic. - **[Retriever Metrics and Results](https://help.salesforce.com/s/articleView?id=data.c360_a_ai_retriever_test_metrics.htm&release=264.0.0&type=5)** Review retriever metrics and the retrieved data chunks to understand the results of your test. Modify the retriever configuration to try different configurations and expected source data to get an optimal response. Save your configuration as a new version of the retriever. - **[Billing Considerations for Testing Retrievers](https://help.salesforce.com/s/articleView?id=data.c360_a_ai_retriever_test_billing.htm&release=264.0.0&type=5)** When you test retrievers by querying search indexes, your data is processed in Data 360. The primary usage type for retriever testing is Data Queries. Use of retriever playground impacts the consumption of credits used for billing in the following usage types. #### See Also - [_Salesforce Help_: Retrieval Augmented Generation (RAG)](https://help.salesforce.com/s/articleView?id=ai.generative_ai_rag.htm&type=5&language=en_US) - [_Salesforce Help_:Ground with Knowledge Using Retrieval Augmented Generation](https://help.salesforce.com/s/articleView?id=ai.prompt_builder_ground_rag.htm&language=en_US) - [_Salesforce Help_: Search for AI, Automation, and Analytics](https://help.salesforce.com/s/articleView?id=data.c360_a_search_index_ground_ai.htm&type=5&language=en_US)