Logo
FrontierNews.ai

Why Tech Companies Are Building Their Own Text-to-Speech Models Instead of Renting Them

Companies are increasingly building and deploying their own text-to-speech systems rather than paying per-character fees to hosted providers like ElevenLabs or Google Cloud. The shift is driven by three factors: runaway costs on metered APIs, data privacy concerns, and the release of open-weight voice models that ship with built-in server infrastructure. For organizations processing high volumes of synthetic speech, the economics are compelling.

What's Driving the Move Away From Hosted Voice APIs?

Hosted text-to-speech services charge by the character or word, and the bills add up fast for companies running customer support bots, audiobook pipelines, game dialogue systems, or accessibility tools. A support bot handling 50,000 calls per month can burn through thousands of dollars in API fees before anyone notices the invoice. Once a company owns the GPU hardware, additional voice generations cost only electricity, not per-character charges.

Data privacy is the second driver. Sending call transcripts, medical notes, or internal scripts to a third-party API means trusting that provider's data retention and security policies. Running the model on your own infrastructure keeps audio inside your network boundary, which matters for healthcare workflows subject to HIPAA regulations or any work under contractual non-disclosure agreements.

The third factor is vendor independence. Open-weight models released under permissive licenses like MIT mean companies are not locked into a provider's pricing tiers, rate limits, or product roadmap. If a vendor changes its pricing tomorrow, a self-hosted deployment does not notice.

Which Open-Source Voice Models Are Competing With ElevenLabs?

Several open-weight text-to-speech models launched in 2026, each targeting the self-hosted use case. ZONOS2, developed by Zyphra, is trained on more than 6 million hours of multilingual speech, a significant jump from the roughly 200,000 hours used for the earlier Zonos-v0.1 release. ZONOS2 uses a mixture-of-experts architecture, which Zyphra positions as delivering expressiveness and quality on par with or surpassing top commercial providers at low latency. The model is released under the MIT license and ships with an OpenAI-compatible HTTP server built in, meaning developers can start generating speech without writing custom API wrappers.

Other contenders include Boson AI's Higgs Audio v3, a 4-billion-parameter model released in June 2026 under a non-commercial license, and Miso Labs' MisoTTS 8B, also released in June 2026 under a modified MIT license. Coqui XTTS v2, a transformer-based model from Coqui and Idiap, also supports voice cloning from short audio samples and has community server implementations.

ZONOS2's combination of MIT licensing and built-in server support makes it the practical choice for developers who want to avoid non-commercial restrictions and skip writing their own HTTP wrapper from scratch.

How to Deploy a Self-Hosted Text-to-Speech System

  • Hardware Requirements: ZONOS2 requires a Linux x86_64 system with an NVIDIA GPU and CUDA toolkit. The model will not start without a compatible GPU. For developers without spare hardware, renting a GPU by the hour from platforms like Vast.ai or RunPod is a cost-effective way to test the system or run low-traffic production deployments.
  • Software Stack: The installation requires Python 3.10, 3.11, or 3.12; torchaudio 2.9.1; transformers between versions 4.56.0 and 4.57.3; the uv package manager; and ffmpeg for audio conversion. Version pinning is critical because CUDA-kernel dependencies are version-sensitive.
  • Production Deployment: A complete setup includes wrapping the model in a production-grade FastAPI gateway with authentication, rate limiting, and Docker containerization. This adds latency-aware buffering and streaming behavior tuning to ensure audio passes through Nginx without delay, which is more sensitive than text generation.
  • Voice Customization: ZONOS2 supports zero-shot voice cloning from reference audio and emotion tuning, allowing developers to generate speech in specific voices or emotional tones without retraining the model.

How Are Enterprises Using Voice AI Beyond Simple Text-to-Speech?

The voice AI ecosystem is expanding beyond basic speech synthesis. Synthesia, a digital avatar startup that reached a $4 billion valuation earlier in 2026, is building interactive avatar systems that combine voice-to-text, language models, text-to-voice, and video generation. Synthesia's tech stack includes its own video and voice models, but the company also allows customers to choose alternatives from other labs including Cartesia, ElevenLabs, Google, or OpenAI.

Synthesia's platform includes three product categories: a video-creation platform where users type scripts and avatars read them; an agentic platform called Sessions where employees can practice sales pitches or customer interactions with interactive AI avatars that respond and score performance; and an API platform where developers can combine Synthesia's models with other services to build custom interactive avatars.

The workflow for creating an interactive avatar involves capturing photos and a two-minute voice recording of a person, then training the system on specific content. The voice-to-text model converts user input into text, a language model processes that text and decides how to respond, the text-to-voice model generates audio, and finally a video model animates the avatar as it speaks. Creating a custom avatar takes a couple of days.

These interactive avatars are deterministic, meaning they only respond to content they were trained on. When asked questions outside their training scope, they redirect users back to their core topic. This design choice prevents the avatar from generating unpredictable or off-topic responses, though it also limits flexibility.

What Are the Practical Implications for Businesses?

The rise of self-hosted and open-source voice models is reshaping the economics of synthetic speech. Companies with high-volume voice generation workloads can now choose between paying per-character fees to hosted providers or investing in GPU infrastructure and managing their own deployments. The break-even point depends on usage volume and the cost of GPU rental or ownership.

For enterprises building interactive avatars or conversational AI systems, the ability to choose voice providers from a menu of options, including ElevenLabs, Google, and OpenAI, reduces vendor lock-in and allows teams to optimize for cost, quality, or latency based on their specific use case.

The tradeoff is operational complexity. Self-hosting means taking responsibility for GPU uptime, managing infrastructure costs, applying security patches, and handling scaling. Hosted APIs abstract away these concerns but charge per unit of output. As open-source models improve and GPU costs decline, the self-hosted path becomes more attractive for organizations with the technical capacity to manage it.