Skip to main content
When using Databricks Genie as an LLM provider on your own key, you can use LLMs deployed through Databricks serving endpoints to power AI features in Omni.

​
Requirements

Databricks Genie requires you to create and configure your own serving endpoints in Databricks before configuring them in Omni. Unlike other providers, there are no pre-configured model options.
To follow the steps in this guide, you’ll need:
  • Organization Admin permissions in Omni
  • In Databricks:

​
Enabling Databricks Genie as a provider

1
In Omni, navigate to AI Hub > General and click the LLM settings tab.
2
In the Providers section, click the Your API keys tab.
3
Click Databricks Genie to open its settings.
4
Add the connection details:
  • Base URL - Enter the serving endpoint URL of your Databricks workspace, for example: https://<your-workspace>.cloud.databricks.com/serving-endpoints
  • API key - Enter your Databricks Personal Access Token
5
In the Custom models field, enter the names of your serving endpoints as a comma-separated list. Each endpoint displays as an LLM that you can approve for users.
The endpoint names you provide must exactly match the serving endpoint names configured in your Databricks workspace. For example, if you named a serving endpoint omni-model-provider, you would enter omni-model-provider in Omni.
6
In the Simple-task model field, enter the name of the serving endpoint to use for light tasks, such as naming a chat and writing summaries. A smaller, faster LLM is recommended.
7
Click Save and approve.
8
To run AI features on Databricks Genie by default, select one of the endpoints as the organization default.
By default, Omni approves all available LLMs once a provider is successfully configured, which means users can select the LLMs in the chat picker. Use the LLM section to revoke specific LLMs, mark an LLM as test only, and add useful descriptions.

​
Disabling Databricks Genie as a provider

In the Your API keys tab, use the toggle next to Databricks Genie to disable it as a provider. After Omni saves the changes, a Delete saved key option will display. Check this option and click Save to permanently delete the key. If you decide to re-enable Databricks Genie later, you’ll need to add a new API key.