We expect your custom LLM to be an OpenAI compatible server.

​
Adding your Custom LLM using dashboard

  1. Click on LLM select dropdown as shown in the image
LLM selection dropdown in Bolna Voice AI agent configuration showing available model options for customization

Choose LLM

  1. From the dropdown click on Add your own LLM.
Add your own LLM option in Bolna dropdown menu for integrating custom large language models with Voice AI agents

Click Add your own LLM

  1. A dialog box will be displayed. Fill in the following details:
  • LLM URL: the endpoint of your custom LLM
  • LLM Name: a name for your custom LLM
click on Add Custom LLM to connect this LLM to Bolna
Custom LLM configuration dialog in Bolna showing URL and name input fields for integrating your custom large language models

Add your custom LLM

  1. Refresh the page
  2. In the LLM settings tab, choose Custom in the first dropdown to select LLM Providers
Custom LLM provider selection in Bolna Voice AI settings showing integrated custom language model options

Choose custom LLM Provider

  1. In the LLM settings tab, you’l now see your custom LLM model name appearing. Select this and save the agent.
Custom LLM model selection interface in Bolna showing available custom LLM models for Voice AI agent configuration

Choose custom LLM Model

Using the above steps will make sure the agent uses your Custom LLM URL.

​
Demo video

Here’s a working video highlighting the flow:
Complete custom LLM workflow in Bolna Voice AI showing step-by-step process for adding your own custom language models

Add custom LLM demo video