Custom

An OpenAI compatible endpoint can be integrated from the Registry > Models page by providing:

• url at which the endpoint is accessible.
• api_key used to authenticate. This will be passed in the header as Authorization: Bearer $API_KEY parameter.
• model key of the model to be used to generate the response.

To do so, please select Custom model provider, openai model adapter, and then fill the necessary fields for the key, url and api_key.

To test the integration, you can use the Test connection button in the model details page.