--- schema_version: "1" id: 1a1f5b3a3bf96fd8c06a2807519eed666c4ae33418e35c3d841263c2f39ca319 title: Monitor and Analyze Einstein Service Replies collection: admin version: current locale: en-us portal_url: https://docs.salesforce.com/admin/current/en-us/ai/264-0-0/generative_ai_analytics_service_reply_insights.md canonical_url: https://help.salesforce.com/s/articleView?id=ai.generative_ai_analytics_service_reply_insights.htm&release=264.0.0&type=5 source_site: help.salesforce.com content_type: documentation content_hash: 9cc4a8b9f1749e8cf8167be9ab97b6a53198793542efc538f7fbd2d074da2c27 description: Evaluate and track the effectiveness of Einstein Service Replies in your organization by creating custom report types that connect case and messaging session data with generative AI audit and feedback data. products: - Agentforce - Cross Cloud release: "264" --- # Monitor and Analyze Einstein Service Replies Evaluate and track the effectiveness of Einstein Service Replies in your organization by creating custom report types that connect case and messaging session data with generative AI audit and feedback data.
Products or Features
  • Data 360
  • Service Cloud
  • Einstein Generative AI
  • Einstein Generative AI Feedback
Roles and Permissions
  • Data Cloud Admin permission set OR Data Aware Specialist permission set
  • View Setup and Customize Application
Two key metrics that can provide valuable insights: - Monitoring the frequency of AI-generated responses per case helps evaluate system usage and direction. High volumes may indicate strong adoption or complex issues needing multiple AI interactions. Low counts might suggest limited use or preference for human intervention. Analyzing these patterns informs necessary adjustments and improvements. - Analyzing user feedback, positive and negative, is crucial for determining the effectiveness of AI-generated replies and identifying areas for refinement. Positive feedback highlights successful AI interactions. To report and analyze generative AI activity on Service Reply use cases that are related to case information, connect the case information and the associated messaging sessions with the generative AI data. Case and messaging session information are stored in Salesforce CRM objects. - Cases are records that are used to track and resolve customer issues. Case records contain information about the case progress and its associated records and can be accessed through Case object. - [Enhanced Chat](https://help.salesforce.com/s/articleView?id=service.reimagine_miaw.htm&type=5&language=en_US) is one of the channels used in Service Cloud to provide your customers with a personalized messaging experience from your mobile app or website to the Service Console. The messaging session object includes information about the messages exchanged. If you are still using legacy [Salesforce Chat](https://help.salesforce.com/s/articleView?id=service.miaw_replacing_chat_considerations.htm&type=5&language=en_US), you’ll be working with the live chat transcript object. - [Generative AI audit and feedback data](https://help.salesforce.com/s/articleView?id=ai.generative_ai_feedback_data_model.htm&release=264.0.0&type=5 "Understand and analyze your Einstein generative AI audit and feedback data by using the appropriate data model objects (DMOs). Einstein generative AI Audit and Feedback data is streamed to a data lake object (DLO) in Data 360 and mapped to data model objects (DMOs).") is stored in Data 360 DMOs. Here’s a diagram that illustrates the components of this solution and the connections between them. ![A flowchart illustrates a data report generation process.](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-ai-generative_ai-264-0-0-production-enus/f8ef6498-d7b2-44e3-9b34-ffd5a850aae9/generative_ai/images/connect_crm_obj_to_gen_ai_audit_feedback.png) Let's review the steps required to implement this solution. - **[Create Data Streams to Monitor Einstein Service Replies](https://help.salesforce.com/s/articleView?id=ai.generative_ai_analytics_service_reply_create_data_streams.htm&release=264.0.0&type=5)** Create data streams to bring the case and message data stored in Salesforce CRM objects into Data 360. - **[Link Case and Messaging DMOs to Generative AI Data](https://help.salesforce.com/s/articleView?id=ai.generative_ai_analytics_service_reply_create_relationships.htm&release=264.0.0&type=5)** Create relationships between your custom data model objects (DMOs) and the generative AI data model objects (DMOs). - **[Create Custom Reports to Monitor Generative AI Requests for Service Replies](https://help.salesforce.com/s/articleView?id=ai.generative_ai_analytics_service_reply_custom_report_case_gtwyrequest.htm&release=264.0.0&type=5)** Create a custom report type and custom report to monitor the number of generative AI requests made for a specific case and its current status. - **[Create Custom Reports to Monitor User Feedback for Service Replies](https://help.salesforce.com/s/articleView?id=ai.generative_ai_analytics_service_reply_create_custom_report_case_genaifeedback.htm&release=264.0.0&type=5)** Create a custom report type and custom report monitor the user feedback and analyze the performance of service replies while handling cases.