---
schema_version: "1"
id: fa0b419f4f5b9fb65c2cbf279716c67a722d8808f1c6623440e593bbdba2c712
title: Batch Models
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/ai/264-0-0/generative_ai_batch_models.md
canonical_url: https://help.salesforce.com/s/articleView?id=ai.generative_ai_batch_models.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: 5cba08f2a7f5f4d8857ae434a2ffbec578590a271d20c6adedf6e818a0e55913
description: Use Prompt Template Batch Processing to generate large quantities of responses for prompt templates asynchronously.
products:
  - Agentforce
  - Cross Cloud
release: "264"
---
# Batch Models

Use Prompt Template Batch Processing to generate large quantities of responses for prompt templates asynchronously.

To asynchronously generate large quantities of responses for prompt templates, you can use Prompt Template Batch Processing. For more information on batch processing, see [Flow Core Action: Prompt Template Actions](https://help.salesforce.com/s/articleView?id=platform.flow_ref_elements_actions_generate_prompt_response.htm&language=en_US&type=5) in Salesforce Help and [Prompt Template Batch Processing](https://developer.salesforce.com/docs/ai/agentforce/guide/prompt-template-batch-job.html) in the Agentforce Developer Guide.

## Native Batch Supported Models

Certain Salesforce-managed models enable batch processing natively supported by the model provider. These models support native batch processing:

- GPT 4.1
- GPT 4.1 Mini
- GPT 4 Omni
- GPT 4 Omni Mini
- GPT 5
- GPT 5 Mini
- OpenAI GPT 4 Omni Mini
- Bedrock Claude Haiku 4.5
- Bedrock Claude Sonnet 4.5

## Native Batch Limits

When using models that support native batch processing, there is a limit of 50,000 items per day. Via Apex, there is a limit of 10,000 items per job, and you can start 5 job runs in 24 hours. For more information on processing batch requests via Apex, see [Prompt Template Batch Processing](https://developer.salesforce.com/docs/ai/agentforce/guide/prompt-template-batch-job.html).

## Batch Model Routing Behavior

![Important](https://sf-zdocs-cdn-prod.zoominsoftware.com/tdta-ai-generative_ai-264-0-0-production-enus/f8ef6498-d7b2-44e3-9b34-ffd5a850aae9/images/icon_important.png)

Important Batch processing doesn't follow geo-aware routing rules and doesn't provide in-region enforcement.

There are different routing behaviors depending on the model provider used for native provider batch processing.

## Azure Batch Model Routing Behavior

Azure native model provider batch processing uses global model endpoints. For these models, batch requests may be processed in regions outside your org's region, even if non-batch LLM requests are restricted to in-region Azure endpoints.

For more information on Azure's global model endpoints, see [Models by deployment type](https://learn.microsoft.com/en-us/azure/ai-foundry/foundry-models/concepts/models-sold-directly-by-azure?view=foundry-classic&pivots=azure-openai&tabs=global-batch%2Cglobal-standard#models-by-deployment-type).

## Bedrock Batch Model Routing Behavior

Native provider batch requests to Anthropic models on Bedrock may route to regions outside of your org's region. Native provider batch requests outside of the United States, Australia, Sweden, Germany, Italy, Ireland, or Japan may be processed in another region.