Einstein Engagement Scoring for Email Model Card

The model analyzed in this card predicts five types of engagement scores for each individual consumer contact in each customer’s business unit. Predictions include email opens and clicks, subscriber retention, web conversion, and overall engagement.

  • Model Details
    The Einstein Engagement Scoring model in Marketing Cloud Engagement predicts customer engagement with email content using these training algorithms, parameters, fairness constraints, and features.
  • Intended Use
    The Einstein Engagement Scoring model in Marketing Cloud Engagement is intended for these use cases.
  • Relevant Factors
    These factors are associated with the Einstein Engagement Scoring model in Marketing Cloud Engagement.
  • Metrics
    Einstein evaluates and monitors model performance metrics to ensure and improve the quality of the model. These performance measures are associated with the Einstein Engagement Scoring model in Marketing Cloud Engagement.
  • Training Data
    You have a customized version of the model that’s trained on your data alone, unless you’re opted in to use global model data. Data from one Salesforce customer doesn’t affect the behavior for another Salesforce customer. While model training happens for each customer on their data, the initial development of the model is validated with a representative set of pilot customers’ data.
  • Ethical Considerations
    Review the ethical factors associated with the Einstein Email Engagement Scoring model in Marketing Cloud Engagement. To avoid bias and other ethical risks, the Einstein Email Engagement Scoring model doesn’t include demographic data.
  • Refresh Cadence
    Review the refresh cadence associated with the Einstein Email Engagement Scoring model in Marketing Cloud Engagement.

Model Details

The Einstein Engagement Scoring model in Marketing Cloud Engagement predicts customer engagement with email content using these training algorithms, parameters, fairness constraints, and features.

Person or Organization

Salesforce Einstein for Marketing Cloud Engagement

Model Date and Version

  • October 2021
  • Minor changes can occur throughout the release
  • Major changes can occur and are communicated via release notes

Model Type

Forecasting, Time-series analysis. Classification, Clustering

General Information

Einstein Email Engagement Scoring predicts five types of engagement scores for each individual consumer contact in each customer’s business unit. The model further classifies each score into one of four categories based on customer-defined thresholds or machine-inferred thresholds. The model analyzes an individual subscriber’s historical events and engagement patterns to forecast future engagement scores. The most recent behavior and engagement patterns are emphasized in the predictions. The web conversion model is a classification model with crafted features based on historical web interaction events. The model clusters predicted engagement scores to derive local threshold boundaries to classify contact engagement levels.

Constraints

A minimum of one email send is required for a contact to have prediction scores.

License

Einstein Email Engagement Scoring is available to Marketing Cloud Engagement customers with any of these editions.

  • Corporate Edition
  • Enterprise Edition
  • Enterprise+ Edition

Intended Use

The Einstein Engagement Scoring model in Marketing Cloud Engagement is intended for these use cases.

Primary Intended Uses

The Einstein Email Engagement Scoring model offers five types of application-specific engagement likelihood for each subscriber. This insight gives you a deeper understanding of your subscribers so you can segment further and target better in future campaigns and sends.

Out-of-Scope Use Cases

Anything other than the primary use case is out of scope and not recommended.

Relevant Factors

These factors are associated with the Einstein Engagement Scoring model in Marketing Cloud Engagement.

Model Input

Einstein Email Engagement Scoring analyzes up to 90 days of historical engagement patterns of the subscribers. The engagement history includes these factors.

  • Email sends, bounces, and engagement events including open, click, and unsubscribe, and associated timestamps
  • User retention and subscription history
  • Subscriber web interaction events including view, search, profile, and purchase, with associated timestamps
  • Data and metadata about customer sending patterns, including how campaigns are executed
  • Categorization thresholds defined by customers when applicable

The engagement history that Einstein Engagement Scoring for Email analyzes excludes these factors.

  • Data purchased or collected from third parties
  • Demographic data that is typically stored in SFMC as data extensions or subscriber or contact attributes
  • Specific content within the email template or rendered email body

Model Output

  • Up to five score types are predicted for each subscriber for each business unit.
  • For each score type, the model produces a list of important factors with impact levels.
  • For each business unit, the model produces an average score across all subscribers and an associated model confidence level.
  • The model produces data extensions that contain each subscriber’s predicted scores and the corresponding category.
  • The model recommends a threshold based on your data that you can use to classify different engagement levels for each score type.

Groups

The model doesn’t use demographic data or other data purchased from third-party data providers.

Environment

The model is trained and deployed in the Marketing Cloud Engagement environment.

Metrics

Einstein evaluates and monitors model performance metrics to ensure and improve the quality of the model. These performance measures are associated with the Einstein Engagement Scoring model in Marketing Cloud Engagement.

Model Performance Measures

Model performance metrics include data such as the model fitness score based on the root mean squared error and mean absolute error, and the data richness score.

Training Data

You have a customized version of the model that’s trained on your data alone, unless you’re opted in to use global model data. Data from one Salesforce customer doesn’t affect the behavior for another Salesforce customer. While model training happens for each customer on their data, the initial development of the model is validated with a representative set of pilot customers’ data.

Ethical Considerations

Review the ethical factors associated with the Einstein Email Engagement Scoring model in Marketing Cloud Engagement. To avoid bias and other ethical risks, the Einstein Email Engagement Scoring model doesn’t include demographic data.

Customers are responsible for interpreting Einstein’s insights, and they must be aware of any assumptions that they make when acting based on the model’s insights. However, adverse outcomes are possible due to model error.

Example
Example The model predicted low engagement for a certain segment, so Phil chooses not to send a marketing communication to that set of customers. But if that prediction was inaccurate, Phil inadvertently caused some customers to miss benefits or opportunities.

Refresh Cadence

Review the refresh cadence associated with the Einstein Email Engagement Scoring model in Marketing Cloud Engagement.

Scores and Models

Einstein Engagement Scoring scores and models for email are updated weekly. The refresh cadence varies by one to several days based on a customer's individual business unit.