***

title: Overview
subtitle: Deepgram Voice Agent in VoxEngine
-------------------------------------------

## Benefits

The native Deepgram module connects any Voximplant call to Deepgram’s Voice Agent API for real-time, speech‑to‑speech conversations.
The integration supports bi-directional audio from phone numbers, SIP trunks, WhatsApp, or WebRTC into Deepgram’s unified agent environment (STT + LLM + TTS)
and play responses via Voximplant’s serverless runtime with minimal latency.

Capability and feature highlights:

* Delivered as a Voice AI Connector inside VoxEngine: you define Deepgram STT, LLM, and TTS parameters; Voximplant handles telephony, media conversion, and streaming WebSockets.
* Fully exposes Deepgram speech recognition, a wide variety of LLM models, and speech synthesis options from Deepgram and partners.
* Bridge PSTN, SIP, WebRTC, or WhatsApp calls into Deepgram Voice Agent using a single VoxEngine scenario.
* Keep conversations natural with low-latency turn‑taking and barge‑in.
* Apply and update agent configuration mid-call.
* Subscribe to Voice Agent events (for example `AgentThinking` and `History`).
* Handle function calls for external integrations.

## Demo video

Deepgram Voice Agent on Voximplant: Enterprise-ready Voice AI Phone Calls with Context Memory

<iframe width="100%" height="360" src="https://www.youtube.com/embed/cAmOmfxoTTA" title="Deepgram Voice Agent on Voximplant: Enterprise-ready Voice AI Phone Calls with Context Memory" frameBorder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowFullScreen />

## Architecture

![Deepgram Voice Agent architecture diagram](https://files.buildwithfern.com/voximplant.docs.buildwithfern.com/0013c75a2d54f6747f5224c15cf1157375a0a2bba636b08c9e5fc08294275e73/docs/assets/diagrams/deepgram-voice-agent-architecture.png)

## Prerequisites

A Deepgram API key is required. Visit [https://console.deepgram.com/signup](https://console.deepgram.com/signup) to create a Deepgram account if you don't have one already.
Then visit the [Deepgram console](https://console.deepgram.com/) to create an API key and copy its secret value.
Use that secret value as your credential in VoxEngine (stored under `DEEPGRAM_API_KEY`).
This is shown in the demo video above: [Getting your Deepgram API Key](https://www.youtube.com/watch?v=cAmOmfxoTTA\&t=32s).

## Development notes

* **Native VoxEngine module**: load with `require(Modules.Deepgram)` and create a `Deepgram.VoiceAgentClient` via `Deepgram.createVoiceAgentClient(...)`.
* **Session setup**: pass Deepgram’s Voice Agents settings object to specify `agent.listen` (STT), `agent.think` (LLM), and `agent.speak` (TTS). Do not include `audio` settings — these are hardcoded by the connector for optimum voice quality with Voximplant.
* **Events**: all Deepgram Voice Agent events are supported under the `Deepgram.VoiceAgentEvents` enum. Subscribe to events such as `ConversationText`, `AgentThinking`, `Warning`, `Error`, and `History`. VoxEngine also provides `WebSocketMediaStarted` and `WebSocketMediaEnded` for debugging media flow.
* **Mid-session updates**: update without reconnecting using `sendUpdatePrompt` and `sendUpdateSpeak`. Inject text with `sendInjectUserMessage` and `sendInjectAgentMessage`.
* **Function calling**: define tools in Deepgram’s `think.functions` array; handle requests via `Deepgram.VoiceAgentEvents.FunctionCallRequest` and respond with `FunctionCallResponse`.
* **Barge‑in**: listen for `Deepgram.VoiceAgentEvents.UserStartedSpeaking` and call `voiceAgentClient.clearMediaBuffer()` to cancel current TTS audio when the user interrupts.
* **Deepgram ASR is a different module**: this connector is independent of VoxEngine’s existing Deepgram ASR module (`VoxEngine.createASR`). You can align ASR parameters with your Voice Agent `listen` configuration for consistent transcription before/after the agent is invoked.

See the [Deepgram module API reference](https://voximplant.com/docs/references/voxengine/deepgram) for full details on methods, events, and types and the examples in this section for usage.

## Examples

* [Example: Answering an incoming call](deepgram-voice-ai-example-answering-incoming-call)
* [Example: Placing an outbound call](deepgram-voice-ai-example-placing-outbound-call)
* [Example: Function calling](deepgram-voice-ai-example-function-calling)
* [Example: Context history with ApplicationStorage](deepgram-voice-ai-example-context-history-appstorage)

## Links

### Voximplant

* Deepgram Voice AI Connector overview: [https://voximplant.com/products/deepgram-client](https://voximplant.com/products/deepgram-client)
* Deepgram Voice Agent getting started guide: [https://voximplant.com/docs/voice-ai/deepgram/voice-agent-api-client](https://voximplant.com/docs/voice-ai/deepgram/voice-agent-api-client)
* Deepgram module API reference: [https://voximplant.com/docs/references/voxengine/deepgram](https://voximplant.com/docs/references/voxengine/deepgram)
* Voice AI product overview: [https://voximplant.ai/](https://voximplant.ai/)

### Deepgram

* Voice Agent API docs: [https://developers.deepgram.com/docs/voice-agent](https://developers.deepgram.com/docs/voice-agent)