Skip to content
AssemblyAI

AssemblyAI speech-to-text for Bolna AI voice agents

AssemblyAI is a streaming speech-to-text provider that turns your caller's speech into text for the Bolna agent's LLM, using the universal-3-6-pro model trained on real voice-agent and phone audio. It is built for the turns that break voice agents: one-word answers, background voices and callers who switch language mid-sentence. Pick it when your calls are full of brand names or product codes, since it takes both a keyword list and a free-form description of the call.

How AssemblyAI fits in the stack.

  • Best for

    Turning the caller's speech into text in real time, in their language.

  • Use this layer when

    You want to tune accuracy, latency, languages or vocabulary for your callers.

  • Connects to

    The phone call upstream, and the LLM that reads the text downstream.

The transcriber is the
listening layer.

AssemblyAI turns the caller's speech into text as they talk, so the LLM can understand it and reply.

  1. Telephony

    Phone network

    • Exotel
    • Plivo
    • Twilio
  2. STT · You are here

    Listener

    • AssemblyAI
  3. LLM

    Reasoning

    • OpenAI
    • Anthropic
    • Google Gemini
  4. TTS

    Voice

    • ElevenLabs
    • Sarvam AI (TTS)
    • Cartesia
  5. Tools

    Actions

    • Cal.com
    • n8n
    • AiSensy

How do I set up AssemblyAI with Bolna?

Which AssemblyAI models and languages does Bolna support?

ModelLanguagesStatus
universal-3-6-pro32: Afrikaans, Arabic, Cantonese, Catalan, Danish, Dutch, English, Estonian, Finnish, French, Galician, German, Hebrew, Hindi, Italian, Japanese, Korean, Mandarin, Marathi, Norwegian, Norwegian Nynorsk, Persian, Portuguese, Romanian, Russian, Spanish, Swedish, Turkish, Urdu, Vietnamese, Xhosa, ZuluRecommended default
universal-3-5-pro19 of the above. It does not cover Afrikaans, Cantonese, Estonian, Galician, Korean, Marathi, Norwegian Nynorsk, Persian, Romanian, Russian, Urdu, Xhosa or ZuluPrevious generation, still supported
universalEnglish onlyDeprecated, not selectable on new agents

For every setting, see the AssemblyAI setup guide in the Bolna docs.

Need an Indian language AssemblyAI does not cover? The docs point to Sarvam or Deepgram.

What can you build with AssemblyAI and Bolna?

  • Lead qualification and confirmations

    Outbound calls that hinge on a short yes or no. universal-3-6-pro makes 52% fewer errors on short answers in heavy background noise than the previous model.

  • Multilingual support lines

    One agent that code-switches across 32 languages, with 74% fewer sessions transcribed in the wrong language than universal-3-5-pro.

  • Calls taken in noisy places

    Shops, households and open offices, where 22% less background speech leaks into the transcript. Set voice_focus to suppress other voices further.

  • Spelled names and card digits

    Bolna passes the agent's last spoken reply to AssemblyAI as context, so when the agent asks for the last four digits, AssemblyAI knows a number is coming.

Other providers in this layer.

See all 10 speech-to-text providers
  • Azure Speech-to-Text

    Speech-to-text

    Azure Speech-to-Text transcribes callers in real time for a Bolna voice agent, with speaker diarization, language identification and phrase lists of up to 2,000 terms.

  • Deepgram

    Speech-to-text

    Deepgram is Bolna's default English transcriber, turning caller speech into text with Nova-3, Nova-2 or Flux streaming models on live phone calls.

  • ElevenLabs Scribe v2 Realtime transcribes callers for a Bolna voice agent in about 150ms, across 90 languages, with word-level timestamps and auto language detection.

Keep exploring the voice stack.

See where AssemblyAI fits in your workflow.

Walk through provider choice, stack trade-offs and the exact workflow you want Bolna to automate.

Ready for enterprise.

Secure, compliant and dependable, from the first pilot to full scale.

Contact Sales
  • 99.9% uptime

    Built for your busiest hour. Even if the model fails, the call doesn’t

  • Support and SLAs

    A dedicated team, with service levels shaped around your business

  • Security & compliance

    Data residency, encryption, access controls, full audit trails and more

  • Deploy in your cloud

    Run Bolna in your own cloud or on-premise, your data remains yours

Certified by

  • ISO 27001
  • DPDP compliant

Frequently Asked Questions

Use universal-3-6-pro. It covers 32 languages against 19 on universal-3-5-pro, makes 45% fewer errors on short answers like "yes" or "no thanks", and AssemblyAI charges the same rate for both.