Most "streaming" TTS systems still wait for a complete sentence before speaking.

X2Streaming-TTS removes that wait. It consumes text tokens as they arrive and generates speech with strict zero lookahead.

The challenge: once speech is played, it cannot be revised.

Take “He finished 3…”—should “3” become “three” in “3 laps,” or “third” in “3rd place”? Speaking too early risks an error; waiting defeats the purpose of streaming.

X2Streaming-TTS addresses this with:

1️⃣ Causal commitment
Ambiguous numbers, units, and symbols are held until their pronunciation becomes clear. Segments are closed using both punctuation and acoustic capacity.

2️⃣ Speech-state inheritance
Waveform-decoder state and acoustic history are carried across segments, preserving pitch, timbre, and continuity.

Results:

⚡ 15.8 ms median TTFT for one request
⚡ Under 120 ms at 64 concurrent requests
🎯 Lowest recognition error in 6/8 evaluated streaming conditions
🔢 0% CER on numeric and streaming-ambiguity tests
🗣️ Quality comparable to evaluated offline baselines

Low-latency voice AI is not just about speaking faster—it is about knowing when it is safe to speak.

Paper: https://arxiv.org/abs/2608.18661
Code: https://github.com/X-Square-Robot/X2Streaming-TTS

#TTS #VoiceAI