Skip to content
Azure OpenAI

Azure OpenAI LLM for Bolna AI voice agents

Azure OpenAI gives a Bolna voice agent the same OpenAI GPT models, served from your own Azure deployment, so you get regional data handling, private networking and Azure's enterprise compliance (SOC 2, HIPAA, ISO 27001). Pick it when your data must stay in a specific region or your organisation already runs on Azure; otherwise the direct OpenAI integration is simpler to set up.

How Azure OpenAI fits in the stack.

  • Best for

    Reasoning, policy handling, tool use and response generation.

  • Use this layer when

    You want to tune quality, cost, latency or function-calling behaviour.

  • Connects to

    Transcribed caller input upstream, and the voice or actions downstream.

The LLM is the
reasoning layer.

Azure OpenAI decides how the agent reads intent, picks the next action, calls your tools and writes the reply. It's the decision engine inside the call.

  1. Telephony

    Phone network

    • Exotel
    • Plivo
    • Twilio
  2. STT

    Listener

    • Deepgram
    • Sarvam AI (STT)
    • Soniox
  3. LLM · You are here

    Reasoning

    • Azure OpenAI
  4. TTS

    Voice

    • ElevenLabs
    • Sarvam AI (TTS)
    • Cartesia
  5. Tools

    Actions

    • Cal.com
    • n8n
    • AiSensy

How do I set up Azure OpenAI with Bolna?

Which models does Bolna support with Azure OpenAI?

ModelContextBest for on BolnaOn the flat rate
gpt-5.4-miniRecommended400K tokensMost voice agents. Recommended for latency and costIncluded
gpt-5.4-nano400K tokensVery high volume, simple tasks. Cheapest optionIncluded
gpt-5.41M tokensGeneral-purpose production agentsBilled by usage
gpt-5.51M tokensMaximum quality on complex tasksBilled by usage
gpt-4.1-mini1M tokensPrevious generation, if already deployedIncluded

The Azure OpenAI setup guide in the Bolna docs covers the API config, reasoning effort and custom deployment names.

Model availability varies by Azure region, and new models reach Azure a little after OpenAI. Check Microsoft's model availability page for your region.

What can you build with Azure OpenAI and Bolna?

  • Healthcare call lines

    Appointment scheduling and reminder agents where patient data has to stay in a chosen region.

  • Financial services support

    Account queries and customer support for teams with data residency rules.

  • Enterprise contact centres on Azure

    Keep the LLM inside the cloud account your security team already manages, with private endpoints. The Bolna docs pair Azure OpenAI with Azure speech-to-text and Azure text-to-speech for enterprise setups.

  • Lower-latency agents in a region

    Deploy to the Azure region closest to your callers and keep reasoning effort at none to cut response time.

Other providers in this layer.

See all 18 LLMs
  • Baseten runs open models for a Bolna voice agent through shared Model APIs or your own Truss deployment on dedicated GPUs, including fine-tuned weights.

  • Cerebras serves gpt-oss-120b at around 3,000 tokens per second as the LLM for a Bolna voice agent, so long replies and tool calls finish almost instantly.

  • Run a Bolna voice agent on any OpenAI-compatible LLM endpoint, from Groq or Together AI to your own vLLM, SGLang, TGI, Ollama or LiteLLM server.

Keep exploring the voice stack.

See where Azure OpenAI fits in your workflow.

Walk through provider choice, stack trade-offs and the exact workflow you want Bolna to automate.

Ready for enterprise.

Secure, compliant and dependable, from the first pilot to full scale.

Contact Sales
  • 99.9% uptime

    Built for your busiest hour. Even if the model fails, the call doesn’t

  • Support and SLAs

    A dedicated team, with service levels shaped around your business

  • Security & compliance

    Data residency, encryption, access controls, full audit trails and more

  • Deploy in your cloud

    Run Bolna in your own cloud or on-premise, your data remains yours

Certified by

  • ISO 27001
  • DPDP compliant

Frequently Asked Questions

Your Azure OpenAI API key, the endpoint URL, the API version and a deployment name. Enter them at platform.bolna.ai/auth/azure or under Settings → Integrations.