> ## Documentation Index
> Fetch the complete documentation index at: https://www.bolna.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Using Custom LLMs with Bolna Voice AI

> Integrate custom large language models (LLMs) into Bolna Voice AI to enhance agent capabilities and tailor responses to your unique requirements

<Note>
  We expect your custom LLM to be an OpenAI compatible server.

  * [https://platform.openai.com/docs/api-reference/chat/create](https://platform.openai.com/docs/api-reference/chat/create)
  * [https://platform.openai.com/docs/api-reference/chat/streaming](https://platform.openai.com/docs/api-reference/chat/streaming)
</Note>

## Adding your Custom LLM using dashboard

1. Click on LLM select dropdown as shown in the image

<Frame caption="Choose LLM">
  <img src="https://mintcdn.com/bolna-54a2d4fe/n6ISBDZpjo2_6G0U/images/using_custom_llm_step_1.png?fit=max&auto=format&n=n6ISBDZpjo2_6G0U&q=85&s=7f798c996177b6b67e241c94a455d7d5" alt="LLM selection dropdown in Bolna Voice AI agent configuration showing available model options for customization" width="1844" height="1204" data-path="images/using_custom_llm_step_1.png" />
</Frame>

2. From the dropdown click on `Add your own LLM`.

<Frame caption="Click Add your own LLM">
  <img src="https://mintcdn.com/bolna-54a2d4fe/n6ISBDZpjo2_6G0U/images/using_custom_llm_step_2.png?fit=max&auto=format&n=n6ISBDZpjo2_6G0U&q=85&s=bb53cfe9e674346fc4159e89c52237d0" alt="Add your own LLM option in Bolna dropdown menu for integrating custom large language models with Voice AI agents" width="1842" height="1216" data-path="images/using_custom_llm_step_2.png" />
</Frame>

3. A dialog box will be displayed. Fill in the following details:

* `LLM URL`: the endpoint of your custom LLM
* `LLM Name`: a name for your custom LLM

click on `Add Custom LLM` to connect this LLM to Bolna

<Frame caption="Add your custom LLM">
  <img src="https://mintlify.s3.us-west-1.amazonaws.com/bolna-54a2d4fe/customizations/images/using_custom_llm_step_3.png" alt="Custom LLM configuration dialog in Bolna showing URL and name input fields for integrating your custom large language models" />
</Frame>

4. **Refresh the page**

5. In the LLM settings tab, choose `Custom` in the first dropdown to select LLM Providers

<Frame caption="Choose custom LLM Provider">
  <img src="https://mintcdn.com/bolna-54a2d4fe/n6ISBDZpjo2_6G0U/images/using_custom_llm_step_4.png?fit=max&auto=format&n=n6ISBDZpjo2_6G0U&q=85&s=c5a1a86a3d1b768f5c5ae4a2ff46605a" alt="Custom LLM provider selection in Bolna Voice AI settings showing integrated custom language model options" width="1844" height="1110" data-path="images/using_custom_llm_step_4.png" />
</Frame>

6. In the LLM settings tab, you'l now see your custom LLM model name appearing. Select this and save the agent.

<Frame caption="Choose custom LLM Model">
  <img src="https://mintcdn.com/bolna-54a2d4fe/n6ISBDZpjo2_6G0U/images/using_custom_llm_step_5.png?fit=max&auto=format&n=n6ISBDZpjo2_6G0U&q=85&s=59de7074168e8fefee8a54ea541bf53f" alt="Custom LLM model selection interface in Bolna showing available custom LLM models for Voice AI agent configuration" width="1838" height="1032" data-path="images/using_custom_llm_step_5.png" />
</Frame>

**Using the above steps will make sure the agent uses your Custom LLM URL**.

## Demo video

Here's a working video highlighting the flow:

<Frame caption="Add custom LLM demo video">
  <img src="https://mintcdn.com/bolna-54a2d4fe/n6ISBDZpjo2_6G0U/images/using_custom_llm_step.gif?s=0bf126714b5b4c774241402c9dd01ee0" alt="Complete custom LLM workflow in Bolna Voice AI showing step-by-step process for adding your own custom language models" width="1152" height="648" data-path="images/using_custom_llm_step.gif" />
</Frame>
