Skip to main content
Omni uses Amazon Web Services (AWS) and Azure to host application deployments. While you can choose the cloud region your Omni application is hosted in, the availability of a specific region is dependent on whether your application is deployed in AWS or Azure. Customer content will be stored and processed in your selected region. AI requests and responses, including any customer content in them, are processed in the inference regions described below.

AI inference regions

Omni’s AI features send requests to an inference provider. The inference provider and region depend on where your Omni application is hosted. The inference region is not always the same as your hosting region.

Primary AI inference providers

AWS deployments use Amazon Bedrock:
The inference regions in the above tables are the default regions for Omni-managed inference. Organization Admins can override these defaults by changing the LLM configuration. The LLM configuration shows where inference is performed.
“Global” means the provider may process AI requests and responses in any region where it offers its services, including outside your hosting region. The inference region only affects where AI requests and responses are processed; where Omni stores your data doesn’t change.

Additional AI inference providers

Some AI features, such as Omni AI, can run on additional inference providers.
Additional inference providers are only available on a per-organization basis, and an Organization Admin must approve them before they can be used.
Baseten currently processes Omni AI requests in the United States only. Approving Omni AI covers processing in any region where Omni AI’s approved inference providers offer their services, so this may change; Omni will update this table before a provider starts processing in a new region. The Omni AI opt-in also approves Fireworks and Databricks. Omni doesn’t use them today, and will add them to this table, with their inference regions, before using either.

Using multiple regions

Each Omni organization account is hosted in a single region. To use Omni across multiple regions, you must maintain an Omni organization account in each region.