Salesforce Docs Portal

Set Up Einstein Generative AI Audit and Feedback

To collect Einstein generative AI audit and feedback data, turn it on in Einstein Setup. For orgs with only one dataspace, it’s turned on by default when Agentforce is turned on.

Required Editions

Available in: Enterprise, Performance, and Unlimited Editions with an Einstein for Sales, Einstein for Platform, Einstein for Service, Einstein 1 Service, or Einstein GPT Service add-on. To purchase add-ons, contact your Salesforce account executive.
User Permissions Needed
To turn on data collection: View Setup
AND
Customize Application
Note
Note
  • Turning on Agentforce automatically turns on Einstein Audit and Feedback Data and Knowledge/RAG Quality Data and Metrics. However, turning off Agentforce doesn't automatically turn these features off. You turn them off manually in Setup.
  • To turn on Einstein generative AI data collection and storage, make sure that Data 360 is provisioned in your Salesforce org and that you’ve turned on Einstein.
  • Agentforce Session Tracing requires Salesforce Standard Data Model version 1.130 or higher.
  • To access pre-built reports and dashboards, make sure that you have Data Cloud User permissions. See Create Data Cloud Users and Assign Permissions.
  • Salesforce stores Generative AI Audit and Feedback data in a data space in Data 360. See Data Model for Generative AI Audit and Feedback.
  1. Verify that you have the latest version of the Salesforce Standard Data Model (version 1.130 or higher) in your org (sandbox or production). From Setup, go to Apps -> Packaging -> Installed Packages -> Salesforce Standard Data Model. To get the required version, click here and follow the instructions.
  2. From Setup, in the Quick Find box, enter Einstein Audit, and then select Einstein Audit, Analytics, and Monitoring Setup.
  3. On the Einstein Audit, Analytics, and Monitoring Setup page, turn Audit and Feedback on or off.
    1. Turn on Audit and Feedback to start collecting data in Data 360. The system provisions your data model, which can take a few minutes, and then starts collecting data.
    2. Turn off Audit and Feedback to stop collecting data and automatically turn off any dependent features.
      Suspending data collection keeps your existing data so that you can resume later. Dashboards, queries, and reports show a gap during which data collection is turned off.
  4. For Dataspace, accept default or select a different target data space in which to store the audit and feedback data.
  5. Verify that the pre-built reports and dashboards are installed and available. It can take a few minutes for the installation to complete.
    Note
    Note After Einstein Generative AI data collection is enabled, it can take a few minutes for the reports and dashboards to become available. If for any reason the reports and dashboards aren’t installed after enabling data collection, the system will continue to retry installation.

    Data collection for Einstein generative AI audit and feedback begins after you turn on data collection and storage. Collected data appears in Data Cloud within 24 hours and refreshes hourly thereafter.

    Note
    Note Turning on Audit and Feedback also activates some Calculated Insights used to measure Prompt Builder usage and feedback. If you don’t plan to use Prompt Builder, you can safely deactivate them. See Enable Prompt Performance Metrics in Prompt Builder (Beta) for more information.
  6. Protect access to collected Agentforce Session Tracing data that is sensitive. Hide sensitive data from unauthorized users. Stored data can contain personally identifying information (PII), protected health information (PHI), payment card information (PCI), and other sensitive information.
    • Use dynamic data masking to redact, nullify, or round sensitive data. For instructions, see Dynamic Data Masking Policies in Data 360.
    • Apply permissions at the data space level. That way, only authorized users can view or query this data. By default, users with the Data Cloud Architect (formerly the Data Cloud Admin) permission set have access to all the data. For instructions, see Implement Data Governance Permissions for Agentforce Session Tracing Objects.
    • The Salesforce System Admin profile includes the Manage All Data Space definition permission, which grants users access to all Data Spaces. If the default Allow All policy is active in the org, users with the System Admin profile can query all Data 360 DMOs. To preserve data security, we recommend deleting the default Allow All policy or editing its scope to apply to specific users. For instructions, see Data Governance in Data 360.

See Also