Skip to main content
Cerebras runs models on its wafer-scale hardware and is built for raw generation speed. Its model catalog lists gpt-oss-120b at around 3,000 tokens per second. On a voice call, fast generation means the full reply is ready almost as soon as the first token arrives, which helps longer answers and agents that call tools mid-turn. The trade-off is a short catalog. Shared Inference offers a small set of models. More model families are available through Dedicated Inference.

​
Models on Shared Inference

Values are from the Cerebras model catalog at the time of writing; check it for the current list.
The context window is smaller on the free trial than on paid tiers. A long system prompt plus a long call can hit the free-tier limit before it hits the paid one.

​
Set up Cerebras

1

Create an API key in the Cloud Console

Sign in to the Cerebras Cloud Console and open API Keys in the left navigation. Create a key.
2

Try the model in the playground

The Cloud Console playground works without a key. Paste your agent’s system prompt and a few caller lines to check tone and length before you wire it up.
3

Choose Cerebras in Bolna

Open Settings → Integrations → LLM → Custom LLM → Add model, or choose + Add custom LLM in an agent’s LLM Provider dropdown. Select Cerebras.
Bolna Add custom model dialog with Cerebras selected and api.cerebras.ai shown as the endpoint placeholder

Cerebras selected in the Add custom model dialog

4

Register the model

  • Model name: an exact Shared Inference model ID such as gpt-oss-120b. For Dedicated Inference, use your endpoint ID instead.
  • Endpoint URL: https://api.cerebras.ai/v1
  • API key: the key from the Cloud Console
  • Family: for example gpt-oss or qwen
Add custom model dialog with Cerebras selected, model gpt-oss-120b, endpoint api.cerebras.ai/v1, masked key and family gpt-oss

Cerebras with gpt-oss-120b

5

Use it on an agent

Choose custom on the agent’s Intelligence tab, pick the Cerebras model, then save.

​
Shared vs Dedicated Inference

With Shared Inference, the model field is a catalog model ID and limits depend on your tier (Free Trial or Pay as You Go). With Dedicated Inference, the model field is your stable endpoint ID, which routes to whichever deployment is active. Because Bolna sends the registered model name as model, register a dedicated endpoint with its endpoint ID as the model name. You can then roll out a new deployment behind the same ID without touching your agents.

​
Troubleshooting

Shared Inference enforces per-tier request and token limits. Check your limits in the Cloud Console, move to Pay as You Go, or ask Cerebras about Dedicated Inference for sustained call volume.
The free tier has the smaller context window. Shorten the system prompt, or upgrade for the full context length.
Model IDs are short and exact, for example gpt-oss-120b, with no organisation prefix. Copy them from the catalog.
Use exactly https://api.cerebras.ai/v1 as the endpoint URL. Bolna appends /chat/completions itself.