The Einstein platform provides you with powerful tools to configure and use large language models (LLMs). Quickly get started with generative AI features by using Salesforce-managed models, which are enabled by default to speed up the configuration process. The Models API allows you to access different models from your apps. Use Prompt Builder to create and manage prompt templates.
To override an agent's or subagent's default model, see Specify Different Models in Agent Script.
| Feature or API | Description | Manage Prompts | Configure Models | Use Models | Build Custom Solutions |
|---|---|---|---|---|---|
| Prompt Builder | Create and manage prompt templates using Salesforce data | Yes | |||
| AI Models | Configure and test AI models | Yes | |||
| BYOLLM | Connect external OpenAI, Azure, Vertex, or Bedrock models to AI Models | Yes | Yes | ||
| LLM Open Connector | Host and connect any custom-built models to AI Models | Yes | Yes | ||
| Models API | Generate text, conversations, and embeddings via Apex and REST; access any AI Models LLM | Yes | Yes |
Configure Your Models
With AI Models, configure Salesforce-managed models and test prompts in a playground environment before using a model in production.
You can also bring your own large language model (BYOLLM) from an LLM provider using your own account. The model is saved to the Model Library in AI Models as a foundation model that you can configure.
To connect any language model (including custom-built models) to the BYOLLM feature in AI Models, you can use the LLM Open Connector API specification.
- Get Started with AI Models
- Salesforce-Managed Models
- Bring Your Own LLM
- Salesforce Help: Add a Foundation Model
- GitHub: LLM Open Connector
Use Models API
Use the Models API to generate text, conversations, or embedding vectors. The Models API provides Apex classes and REST endpoints that connect your application to LLMs from Salesforce partners, including Anthropic, Google, and OpenAI.
- Models API Developer Guide
- Access Models API with Apex
- Access Models API with REST
- Build Lightning Web Components and Flows with Models API
Design and Run Prompt Templates
Simplify daily tasks by integrating prompt templates, powered by generative AI, into workflows. Create, test, revise, customize, and manage prompt templates that incorporate your CRM data from merge fields that reference record fields, flows, related lists, and Apex. Prompt Builder helps you to make effective prompts that safely connect you and your data with LLMs.
See Also
- Salesforce Help: Einstein Generative AI
- Salesforce Help: Agentforce and Generative AI Usage and Billing