VocodeOpen-source framework for building real-time voice AI agents from speech-to-text, LLM, and text-to-speech components

Vocode is an open-source library for building voice-based conversational AI applications. It provides the plumbing needed to connect speech recognition, large language models, and speech synthesis into a single real-time pipeline, allowing developers to create agents that can listen, reason, and speak over phone calls, web sockets, or local audio. The framework is primarily distributed as a Python SDK, with a focus on streaming audio so that conversations feel responsive rather than turn-based with long delays. It handles the orchestration concerns that make voice agents difficult to build from scratch, such as managing interruptions (barge-in), buffering and streaming transcription, and coordinating the back-and-forth between transcriber, agent logic, and synthesizer. Vocode is designed to be modular and provider-agnostic. It integrates with a range of third-party services for each stage of the pipeline — for example transcription providers like Deepgram and AssemblyAI, language models such as those from OpenAI, and text-to-speech engines including ElevenLabs, Azure, and others. Developers can swap components in and out depending on cost, latency, and voice quality requirements. A common use case is telephony: Vocode supports placing and receiving phone calls through providers like Twilio, which makes it suitable for building automated outbound and inbound call agents, voice assistants, and customer-facing phone bots. It also supports browser-based and local-microphone conversations for in-app voice experiences. Because it is open source and self-hostable, Vocode appeals to teams that want control over their stack and the ability to customize agent behavior, rather than relying on a fully managed closed platform. The trade-off is that building production-grade voice agents still requires wiring together and paying for external transcription, LLM, and TTS services, and tuning latency and conversational behavior. It sits in a growing space of voice-agent tooling alongside managed platforms and other frameworks; its main differentiator is the open-source, composable approach that gives developers direct access to the pipeline internals.