Generate Tests from Knowledge Sources

When your agent is connected to an Agentforce Data Library, you can generate test scenarios directly from the content linked to that library. You can base test cases on multiple data sources including articles and knowledge fields or uploaded files.

Required Editions

This article applies to:	New Testing Center in Agentforce Studio (Beta)
This article doesn’t apply to:	Legacy Agentforce Testing Center in Setup

Available in: Lightning Experience

Available in: Enterprise, Performance, Unlimited, and Developer Editions. Required add-on licenses vary by agent type.

User Permissions Needed
To create tests in the Testing Center:	Manage Agentforce Grids AND Manage Agentforce Testing

User Permissions Needed

To create tests in the Testing Center:

Manage Agentforce Grids

AND

Manage Agentforce Testing

To get started define the test focus with a brief description, and have the system generate test cases. The testing center generates question-and-answer style test cases based on the knowledge content available to the agent.

Note Generate Tests from Knowledge Sources supports turn-level testing only. Conversation-level testing isn't supported for this data type.

To create test cases from your knowledge, select Generate test cases based on knowledge available to this agent.

Note You can generate tests only for agents connected to data libraries based on knowledge articles and fields, or file uploads. Agents connected to data libraries based on custom retrievers or web sources aren't supported.

Note Test cases are drafted in the Agentforce Agent's default language. For supported languages, see Considerations for Testing Center.
Specify how many test cases you want to generate. You can generate up to 200 test cases at a time.
Enter a description to help guide the AI model about the purpose and scope of your testing. Click Next.

How does the test description influence my tests?

The test description is included in the prompt and guides how your test cases are generated by defining the test focus or theme. Keywords and phrases in the description help narrow the information that tests are built around, which is especially useful when your agent is linked to multiple sources like articles or PDFs.

While you can’t customize the format or complexity of tests in the description, you can help define the test focus by using relevant terms and phrases. Although perfect grammar isn’t required, using complete sentences to write out the descripton helps both AI and human reviewers understand your intent and improves the output's relevance.

Note Generative AI can generate test cases for Account, Lead, Opportunity, and Contact objects. With specific instructions in the description, it can also create test cases for custom objects and the Answer Questions with Knowledge action. For example, for custom objects, use a description similar to this: “Generate test cases for [custom object name]. Sample utterances are: [sample utterance related to custom object], [sample utterance related to custom object].” To have AI create test cases for the Answer Questions with Knowledge action, use a description similar to this: “Generate test cases for the Answer Questions with Knowledge action. Use the following knowledge articles for generating tests: [title of an article], [title of an article].”