---
schema_version: "1"
id: d926aa57a1f78ea53bf83827fe9d0657a65e3335a4244e3fb4a00d36fe04ae7b
title: Content Safety and Security
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/ai/264-0-0/generative_ai_trust_content_safety_and_security.md
canonical_url: https://help.salesforce.com/s/articleView?id=ai.generative_ai_trust_content_safety_and_security.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: 8c48678c52a2cb269bf4bb93cad5277801a001edd840b9a09eefae9c36f894ad
description: Einstein Trust Layer includes a set of policies to help detect potentially harmful content and malicious attacks that attempt to compromise the safety and security of AI applications.
products:
  - Agentforce
  - Cross Cloud
release: "264"
---
# Content Safety and Security

Einstein Trust Layer includes a set of policies to help detect potentially harmful content and malicious attacks that attempt to compromise the safety and security of AI applications.

### Required Editions

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small edition"><colgroup><col></colgroup><tbody><tr class=""><td class="slds-cell-wrap" style="vertical-align:top;">Available in: <strong>Enterprise</strong>, <strong>Performance</strong>, and <strong>Unlimited</strong> Editions with an Einstein for Sales, Einstein for Platform, Einstein for Service, Einstein 1 Service, or Einstein GPT Service add-on. To purchase add-ons, contact your Salesforce account executive.</td></tr></tbody></table>

## Harmful Content

Harmful content refers to information that can have detrimental effects on individuals or communities. In the context of generative AI models, harmful content refers to data in prompts or responses that negatively impact mental health, behavior, or well-being. Harmful content can include toxic material such as hate and violence or content that has unfair or discriminatory patterns.

Large Language Models (LLMs) can inadvertently generate harmful content due to several reasons:

- Prompt influence: The language in the prompt directly influences the model’s output. For example, if the prompt contains offensive or harmful phrases, the model can incorporate similar language in its response.
- Training data: LLMs learn from vast amounts of data, which can include biased or toxic content. If the training data contains harmful language, the model can inadvertently reproduce it.
- Contextual patterns: LLMs generate responses based on statistical patterns in the data. If harmful language appears frequently in similar contexts, the model can replicate those patterns.
- Fine-tuning and transfer learning: Fine-tuning LLMs on specific tasks can introduce biases. Transfer learning from unrelated domains can also affect content generation.

Einstein Trust Layer uses machine learning models to identify harmful content in generative AI applications and features.

## Prompt Injections

Prompt injections are attempts to make the LLM do something that it isn’t designed to do. Hackers can create prompts that attempt to override the system policies or manipulate the LLM into doing something unintended.

Salesforce provides prompt defense mechanisms to help mitigate risks posed by malicious attacks.

Prompt injection detection together with the system policies provide an in-depth approach to prompt defense. Prompt injection defense is consistently applied to all user prompts, bolstering security in Agentforce and embedded AI applications.

- We have built-in system policies to help limit hallucinations and decrease the likelihood of unintended or harmful outputs by the LLM.
- Prompt injection detection is used to help detect malicious attacks that attempt to manipulate the LLMs into doing something it wasn’t designed to do.

#### See Also

- [Toxicity Detection](https://help.salesforce.com/s/articleView?id=ai.generative_ai_trust_toxicity_detection.htm&release=264.0.0&type=5 "Einstein Trust Layer uses machine learning (ML) models to identify and flag toxic content in prompts and responses.")
- [Prompt Injection Detection (Beta)](https://help.salesforce.com/s/articleView?id=ai.generative_ai_trust_prompt_injection_detection.htm&release=264.0.0&type=5 "Prompt Injection, sometimes referred to as “jailbreak,” is a large language model (LLM) vulnerability. Prompt injections are attempts to make the LLM do something that it isn’t designed to do. Hackers can create prompts that attempt to override the system policies or manipulate the LLM into doing something unintended.")