- Using locally hosted models through Ollama (e.g.,
llama3.1:70b) - Using Azure OpenAI deployments with custom names
- Using newly released models before they’re added to the default list
- Using fine-tuned or specialized models
Requirements
To follow the steps in this guide, you’ll need:- An Omni Enterprise plan. Contact your Omni Account Executive or Omni support to learn more.
- Organization Admin permissions in Omni
- An OpenAI API key
Enabling a custom OpenAI model as a provider
Open the LLM settings
- In Omni, navigate to AI Hub > General and click the LLM settings tab.
- In the Providers section, click the Your API keys tab.
- Click to open its settings.
Add your connection details
Fill in the following fields:
- Base URL - Optional. If your endpoint uses a different base URL (such as for Azure OpenAI or Ollama), enter it in this field.
- API key - Required. Enter your OpenAI API key.
Specify custom models
In the Custom models field, enter your model identifiers as a comma-separated list (e.g.,
llama3.1:70b, gpt-4-turbo-2024-04-09, or your Azure deployment name).Custom models default to a 400,000-token context window.
Select a Simple-task model
In the Simple-task model dropdown, select the LLM to use for light tasks, such as naming a chat and writing summaries. To use a custom model, select Custom model identifier and enter the identifier in the field that appears.
Save and set organization defaults
- Click Save and approve.
- To run AI features on by default, select one of the as the organization default.

