Telenow
LLM modelsBYOK supported

Groq for AI voice agents

Groq is one of the LLMs you can run a Telenow AI voice agent on. Fastest tokens-per-second on hosted open models. Pick a Groq model as the agent's brain and it drives the whole conversation — understanding the caller, deciding what to say, and calling your tools — fast enough to keep a live call natural. Mix and match it with any LLM, STT, TTS and carrier — Telenow is component-level, so you're never locked in.

Last updated 2026-06-25

Groq models for voice

ModelContextInput /MOutput /MFirst tokenTools
Llama 3.1 8B Instant131K$0.05$0.08~140ms
Llama 3.3 70B Versatile131K$0.59$0.79~220ms
GPT-OSS 20B (reasoning)131K$0.075$0.3~350ms
GPT-OSS 120B (reasoning)131K$0.15$0.6~450ms

Frequently asked questions

Can I use Groq for an AI voice agent?

Yes — Groq is a first-class LLM option in Telenow. Select a Groq model as your agent's brain and it powers real-time voice and chat conversations.

Which Groq models can I use?

Llama 3.1 8B Instant, Llama 3.3 70B Versatile, GPT-OSS 20B (reasoning), and GPT-OSS 120B (reasoning) — Telenow lists the low-latency Groq models that keep the first reply fast on a live call.

Does Groq support tools / function calling?

Yes — the listed Groq models support function calling, so your agent can take actions (book, pay, look up, transfer) mid-conversation.

How much does Groq cost for a voice agent?

You pay Groq's usage at cost plus Telenow's transparent platform fee — billed per component (speech, model, telephony) and per minute, with new accounts getting free signup credit to try it.

Can I bring my own Groq API key?

Yes. Telenow supports BYOK — paste your own Groq key to bill Groq usage to your account, or use the platform key and pay through Telenow.

Other llm models options

OpenAI
Industry-leading reasoning, broad tool-call support. Only low-latency chat models are listed — slow reasoning models (o1 / o3) are deliberately excluded, they stall the first reply on a live call.
Anthropic
Strong reasoning and tool use; great for nuanced personas. For live calls prefer Haiku (fastest/cheapest) or Sonnet (balanced) — Opus is higher quality but pricier and slower to first token.
Google Gemini
Gemini 2.5 family via the Gemini API (OpenAI-compatible). Flash and Flash-Lite are fast + cheap with huge context — strong defaults for live calls; Pro for the hardest reasoning.
xAI Grok
Grok via the xAI API (OpenAI-compatible). Grok 4 Fast (non-reasoning) is built for low-latency chat with a 2M context; Grok 3 mini is the budget pick. Always-on reasoning Grok 4 is excluded — too slow to first token for live calls.
OpenRouter
One key, hundreds of models through an OpenAI-compatible gateway. Type or paste ANY model ID from openrouter.ai/models (e.g. anthropic/claude-sonnet-4.5) — the suggestions are just popular call-friendly picks; pricing roughly tracks the underlying provider.
Azure OpenAI
OpenAI models hosted in your Azure tenancy. The deployment you configure below selects the model; the chosen model here is used for the cost/latency estimate. Requires endpoint + deployment + API version.
AWS Bedrock
Claude, Llama and Amazon Nova through AWS Bedrock (unified ConverseStream API). Bring your own AWS credentials, or leave them blank to use the platform AWS account.
Custom API (full agentic workflow)
You already built an agentic workflow on your server — tools, RAG, memory, system prompt all live with you. We just attach voice (STT + TTS) and pipe each user turn through your SSE endpoint.
Custom LLM (open-source / self-hosted)
Point at any OpenAI-compatible endpoint — Ollama, vLLM, llama.cpp, LM Studio, or a self-deployed model. We treat it exactly like OpenAI: same chat-completions wire format, your model + your URL. Tools work too.
₹300.00 free credit on signup

Build a voice agent with Groq

Sign up free and get ₹300.00 in credit — no card required. Connect your number, pick a template, and go live in minutes.

Start free Talk to sales