---
schema_version: "1"
id: 657aebd8507251c82151a414bbff8f440b338e8c515a3ccac0110b1296dc1c7c
title: Geo-Aware Routing for OpenAI and Azure OpenAI
collection: admin
version: current
locale: en-us
portal_url: https://docs.salesforce.com/admin/current/en-us/ai/264-0-0/generative_ai_platform_geo_aware_routing_openai.md
canonical_url: https://help.salesforce.com/s/articleView?id=ai.generative_ai_platform_geo_aware_routing_openai.htm&release=264.0.0&type=5
source_site: help.salesforce.com
content_type: documentation
content_hash: df1f83a564aa693222da23bd94c701aeb55b238e23afa4155d91703174c45cf1
description: A geo-aware model, such as GPT 4.1, uses OpenAI or Azure OpenAI to service LLM requests. The same underlying model is used by OpenAI and Azure OpenAI.
products:
  - Agentforce
  - Cross Cloud
release: "264"
---
# Geo-Aware Routing for OpenAI and Azure OpenAI

A geo-aware model, such as GPT 4.1, uses OpenAI or Azure OpenAI to service LLM requests. The same underlying model is used by OpenAI and Azure OpenAI.

### Required Editions

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small edition"><colgroup><col></colgroup><tbody><tr class=""><td class="slds-cell-wrap" style="vertical-align:top;">Available in: <strong>Enterprise</strong>, <strong>Performance</strong>, and <strong>Unlimited</strong> Editions with an Einstein for Sales, Einstein for Platform, Einstein for Service, Einstein 1 Service, or Einstein GPT Service add-on. To purchase add-ons, contact your Salesforce account executive.</td></tr></tbody></table>

Requests in the United States are serviced in the United States by OpenAI, and in some cases Azure OpenAI. Requests outside the United States are routed to a supported Azure OpenAI endpoint that is closest to where your Einstein generative AI platform instance is located.

## GPT 4.1

This table shows geo-aware routing for requests for GPT 4.1. Each geo-aware model has its own set of model regions where model endpoints are deployed. Models other than GPT 4.1 may not have model endpoints in all the regions listed in the table. For more information for each model, see [Large Language Model Support](https://help.salesforce.com/s/articleView?id=ai.generative_ai_large_language_model_support.htm&release=264.0.0&type=5 "Understand supported large language models (LLMs) from multiple providers for embedded features, such as Prompt Builder. Identify the Salesforce-managed models that are available out of the box. Learn how you can bring your own model (BYOLLM) by using AI Models (formerly Einstein Studio).").

The columns are:

- **Salesforce Org Region**: The region where a Salesforce org is hosted
- **Primary Model Endpoint Region**: The primary region for the Azure OpenAI endpoint
- **Secondary Model Endpoint Regions**: The secondary in-region model endpoints where model requests are retried if the primary model endpoint isn't responsive. If the primary and secondary endpoints aren't responsive, the request falls back to Azure OpenAI in the United States. If the request fails on each primary and secondary model endpoint and the model endpoints in the United States, an error is returned. See the Disable Fallback to the United States section after the table.

<table class="slds-table slds-table_bordered slds-max-medium-table_stacked slds-m-bottom_small ">
        <colgroup>
          <col>
          <col>
          <col>
        </colgroup>
        <thead class="slds-text-title_caps ">
          <tr class="">
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d164401e108">Salesforce Org Region</th>
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d164401e111">Primary Model Endpoint Region</th>
            <th scope="col" class="slds-cell-wrap" style="vertical-align:top;" id="d164401e114">Secondary Model Endpoint Regions</th>
          </tr>
        </thead>
        <tbody>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Australia</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Australia</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Brazil</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Brazil</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Canada</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Canada</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">France</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">France</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">
              <ul>
                <li>Germany</li>

                <li>Italy</li>

                <li>Sweden</li>

              </ul>
            </td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Germany</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Germany</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">
              <ul>
                <li>France</li>

                <li>Italy</li>

                <li>Sweden</li>

              </ul>
            </td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">India</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">India</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Indonesia</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Australia</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Italy</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Italy</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">
              <ul>
                <li>France</li>

                <li>Germany</li>

                <li>Sweden</li>

              </ul>
            </td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Japan</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Japan</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">South Korea</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Japan</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Singapore</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Singapore</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Sweden</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Sweden</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">
              <ul>
                <li>France</li>

                <li>Germany</li>

                <li>Italy</li>

              </ul>
            </td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">Switzerland</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">Sweden</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">
              <ul>
                <li>France</li>

                <li>Germany</li>

                <li>Italy</li>

              </ul>
            </td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">United Kingdom</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">United Kingdom</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
          <tr class="">
            <td data-label="Salesforce Org Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e108 ">United States</td>

            <td data-label="Primary Model Endpoint Region" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e111 ">United States</td>

            <td data-label="Secondary Model Endpoint Regions" class="slds-cell-wrap" style="vertical-align:top;" headers="d164401e114 ">None</td>

          </tr>
        </tbody>
      </table>

## Disable Fallback to the United States

Before you can disable the final fallback to the United States, you must turn on Data 360. Data 360 is automatically provisioned as soon as a Data Cloud license is added to your Salesforce org. See [Turn On Data 360](https://help.salesforce.com/s/articleView?id=data.c360_a_setup_provision.htm&language=en_US).

To disable the final fallback to the United States, go to Einstein Setup and toggle Turn Off Model Provider Region Fallback. Instead of falling back to the United States, an error is returned. Requests are still tried on the primary and secondary model endpoints before an error is returned.

## Batch Processing

To asynchronously generate large quantities of responses for prompt templates, you can use prompt template batch processing. These models support a global endpoint for native batch processing by Azure OpenAI.

- GPT 4 Omni
- GPT 4 Omni Mini
- GPT 4.1

For these models with global endpoints, batch requests may be processed in regions outside your org’s region, even if non-batch LLM requests are restricted to specific in-region Azure endpoints. Batch processing doesn't follow geo-aware routing rules and doesn’t provide in-region enforcement.

For more information about batch processing, see [Prompt Template Batch Processing in Apex](https://developer.salesforce.com/docs/ai/agentforce/guide/prompt-template-batch-job.html) in the Agentforce Developer Guide.

#### See Also

- [Geo-Aware LLM Request Routing on the Einstein Generative AI Platform](https://help.salesforce.com/s/articleView?id=ai.generative_ai_platform_geo_aware_routing.htm&release=264.0.0&type=5 "The Einstein generative AI platform routes large language model (LLM) requests to servers that are closest to where your Einstein generative AI platform instance is located. Geo-aware routing includes LLM API requests made by Einstein generative AI features that use the Einstein generative AI platform.")
- [_External_: Data, privacy, and security for Azure OpenAI Service](https://learn.microsoft.com/en-us/legal/cognitive-services/openai/data-privacy)