> ## Documentation Index
> Fetch the complete documentation index at: https://www.bolna.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Choose and Configure LLM Models for Voice AI

> Select and configure the language model for your Bolna Voice AI agent. Choose from OpenAI, Azure, Anthropic, connect knowledge bases, and set up guardrails.

## What is the LLM Tab?

The LLM Tab is where you select and configure the intelligence behind your voice AI agent. Choose your language model provider, adjust response parameters, and connect knowledge bases for enhanced conversations.

<Frame caption="LLM Tab on Bolna Playground">
  <img src="https://mintcdn.com/bolna-54a2d4fe/nkJ9nAjMGNa34kLN/images/getting-started/agent-setup/llm-tab.png?fit=max&auto=format&n=nkJ9nAjMGNa34kLN&q=85&s=74484fa41dcbf3faeaa672dec8d39b77" alt="LLM Tab showing model selection, parameters, and knowledge base options" width="1024" height="762" data-path="images/getting-started/agent-setup/llm-tab.png" />
</Frame>

***

## Configuration Options

### Choose LLM Model

Select your AI provider and model for conversation intelligence.

<Frame caption="LLM Model Selection">
  <img src="https://mintcdn.com/bolna-54a2d4fe/nkJ9nAjMGNa34kLN/images/getting-started/agent-setup/llm-model.png?fit=max&auto=format&n=nkJ9nAjMGNa34kLN&q=85&s=5bf9a8c4fcc6554923efe1df72af24eb" alt="Choose LLM model with Azure provider and gpt-4.1-mini cluster selected" width="1024" height="143" data-path="images/getting-started/agent-setup/llm-model.png" />
</Frame>

<CardGroup cols={2}>
  <Card title="Provider Selection" icon="plug">
    Choose from Azure, OpenAI, Anthropic, Groq, and more
  </Card>

  <Card title="Model Selection" icon="microchip">
    Pick the specific model (e.g., `gpt-4.1-mini cluster`)
  </Card>
</CardGroup>

<Tip>
  Connect your own provider keys in [Providers](/getting-started/providers) to reduce costs and access more models.
</Tip>

***

### Model Parameters

Fine-tune how your agent generates responses.

<Frame caption="Model Parameters Configuration">
  <img src="https://mintcdn.com/bolna-54a2d4fe/nkJ9nAjMGNa34kLN/images/getting-started/agent-setup/llm-parameters.png?fit=max&auto=format&n=nkJ9nAjMGNa34kLN&q=85&s=558d3ac6db8db9fb521410c684f404f4" alt="Model Parameters section showing Tokens and Temperature sliders with Knowledge Base dropdown" width="1024" height="346" data-path="images/getting-started/agent-setup/llm-parameters.png" />
</Frame>

| Parameter            | Description                    | Recommended                    |
| -------------------- | ------------------------------ | ------------------------------ |
| **Tokens Generated** | Max tokens per LLM output      | 300-500 for concise responses  |
| **Temperature**      | Controls creativity/randomness | 0.3-0.5 for balanced responses |

<Warning>
  **Keep temperature low** (0.3-0.5) if you want consistent, controlled responses. Higher temperature increases creativity but may cause deviation from your prompt instructions.
</Warning>

***

### Add Knowledge Base

Connect your knowledge bases to give your agent accurate, contextual information.

<Frame caption="Knowledge Base Multi-Select">
  <img src="https://mintcdn.com/bolna-54a2d4fe/uH9lQxF0tYMrhiL9/images/getting-started/agent-setup/llm-knowledge-base.png?fit=max&auto=format&n=uH9lQxF0tYMrhiL9&q=85&s=c8489689cf946ce1dcaf9101ac88fe21" alt="Knowledge base dropdown showing connected URLs and PDFs with Add new knowledgebase option" width="1024" height="583" data-path="images/getting-started/agent-setup/llm-knowledge-base.png" />
</Frame>

<Steps>
  <Step title="Click the Dropdown">
    Open the **"Select knowledge bases"** multi-select dropdown.
  </Step>

  <Step title="Select Knowledge Bases">
    Check one or more knowledge bases (PDFs, URLs) to connect.
  </Step>

  <Step title="Create New (Optional)">
    Click **"Add new knowledgebase"** to create and upload new content.
  </Step>
</Steps>

<Info>
  Knowledge bases enable your agent to answer questions with accurate, up-to-date information from your documents and URLs. Connect multiple knowledge bases for comprehensive coverage.
</Info>

<Tip>
  Create knowledge bases in the [Knowledge Base](/getting-started/knowledge-base) section by uploading PDFs or adding URLs.
</Tip>

***

### Add FAQs & Guardrails

Create structured responses and safety controls for your agent.

<Frame caption="FAQs & Guardrails Section">
  <img src="https://mintcdn.com/bolna-54a2d4fe/uH9lQxF0tYMrhiL9/images/getting-started/agent-setup/llm-guardrails.png?fit=max&auto=format&n=uH9lQxF0tYMrhiL9&q=85&s=8a58e04e1afe75e5dee08c310b56b602" alt="Add FAQs and Guardrails section with button to add new blocks" width="1024" height="177" data-path="images/getting-started/agent-setup/llm-guardrails.png" />
</Frame>

<CardGroup cols={2}>
  <Card title="FAQs" icon="circle-question">
    Pre-defined answers to common questions that bypass LLM generation for faster, consistent responses
  </Card>

  <Card title="Guardrails" icon="shield" href="/guardrails">
    Safety rules that control inappropriate content and maintain professional boundaries
  </Card>
</CardGroup>

Click **"Add a new block for FAQs & Guardrails"** to open the configuration modal:

<Frame caption="Add New Block Modal">
  <img src="https://mintcdn.com/bolna-54a2d4fe/uH9lQxF0tYMrhiL9/images/getting-started/agent-setup/llm-guardrails-modal.png?fit=max&auto=format&n=uH9lQxF0tYMrhiL9&q=85&s=42680d25d0647fe848ec2b8116037801" alt="Modal for adding FAQs and Guardrails with Name, Response, Threshold, and Utterances fields" width="703" height="1024" data-path="images/getting-started/agent-setup/llm-guardrails-modal.png" />
</Frame>

<Steps>
  <Step title="Name Your Block">
    Give a descriptive name (e.g., "Pricing Questions", "Off-Topic Deflection").
  </Step>

  <Step title="Set the Response">
    Define the forced response when this rule triggers.
  </Step>

  <Step title="Configure Threshold">
    Set matching sensitivity (0.9 = strict, lower = more matches but may trigger unintentionally).
  </Step>

  <Step title="Add Utterances">
    Add up to 20 example phrases that should trigger this response.
  </Step>
</Steps>

<Warning>
  **Lower thresholds** increase matching likelihood but may cause false triggers. Start with 0.8-0.9 and adjust based on testing.
</Warning>

<Info>
  **[Learn more about Guardrails →](/guardrails)** to understand how to maintain professionalism, ensure compliance, and protect your brand during AI conversations.
</Info>

***

## Next Steps

<CardGroup cols={2}>
  <Card title="Knowledge Base" icon="book" href="/getting-started/knowledge-base">
    Create and manage knowledge bases
  </Card>

  <Card title="Guardrails Guide" icon="shield" href="/guardrails">
    Learn guardrails best practices
  </Card>

  <Card title="Agent Tab" icon="file-lines" href="/agent-setup/agent-tab">
    Configure prompts and welcome message
  </Card>

  <Card title="LLM Providers" icon="plug" href="/getting-started/providers">
    Connect your own LLM provider
  </Card>
</CardGroup>


Built with [Mintlify](https://mintlify.com).