Skip to main content
When using Databricks Genie as an LLM provider on your own key, you can use LLMs deployed through Databricks serving endpoints to power AI features in Omni.

Requirements

Databricks Genie requires you to create and configure your own serving endpoints in Databricks before configuring them in Omni. Unlike other providers, there are no pre-configured model options.
To follow the steps in this guide, you’ll need:
  • An Omni Enterprise plan. Contact your Omni Account Executive or Omni support to learn more.
  • Organization Admin permissions in Omni
  • In Databricks:

Enabling Databricks Genie as a provider

1

Open the LLM settings

  1. In Omni, navigate to AI Hub > General and click the LLM settings tab.
  2. In the Providers section, click the Your API keys tab.
  3. Click to open its settings.
2

Add your connection details

Fill in the following fields:
  • Base URL - Enter the serving endpoint URL of your Databricks workspace, for example: https://<your-workspace>.cloud.databricks.com/serving-endpoints
  • API key - Enter your Databricks Personal Access Token
3

Add custom model endpoints

In the Custom models field, enter the names of your serving endpoints as a comma-separated list. Each endpoint displays as an LLM that you can approve for users.
The endpoint names you provide must exactly match the serving endpoint names configured in your Databricks workspace. For example, if you named a serving endpoint omni-model-provider, you would enter omni-model-provider in Omni.
4

Specify a Simple-task model

In the Simple-task model field, enter the name of the serving endpoint to use for light tasks, such as naming a chat and writing summaries. A smaller, faster LLM is recommended.
5

Save and set organization defaults

  1. Click Save and approve.
  2. To run AI features on by default, select one of the as the organization default.
By default, Omni approves all available LLMs once a provider is successfully configured, which means users can select the LLMs in the chat picker. Use the LLM section to revoke specific LLMs, mark an LLM as test only, and add useful descriptions.

Disabling Databricks Genie as a provider

In the Your API keys tab, use the toggle next to to disable it as a provider. After Omni saves the changes, a Delete saved key option will display. Check this option and click Save to permanently delete the key. If you decide to re-enable later, you’ll need to add a new API key.