跳到正文
原文
Rohan Paul· @rohanpaul_ai · X·· 6 小时前AI 评分54
AI 导读

Inworld 收购 Ultravox,一家公司同时拥有 AI 智能体的语音能力和运行平台。Ultravox 是开发者构建实时语音智能体的平台,能处理理解、推理、工具调用和打断时的时机控制。

正文

. @Inworld has acquired @ultravox_dot_ai, so one company now owns both the voice an AI agent speaks with and the platform the agent runs on.

Ultravox is a platform developers use to build real-time voice agents, which are AIs people talk to out loud, like a support line, a tutor, or a companion app.

An agent like that has to do several things at once: understand what the person said and what they meant, reason about it, call whatever tools it needs to actually get the task done, and reply. Ultravox handles all of that.

It also handles the part that makes these agents feel robotic when it goes wrong, which is timing. The agent has to tell the difference between someone pausing to think and someone actually being done, and if the user cuts in mid-sentence it has to stop talking and listen instead of plowing on.

Inworld is an AI research lab and inference provider, meaning it trains its own speech models and runs LLMs for other companies through APIs used by some of the largest consumer AI apps.

Ultravox customers get the first benefit right away, because every built-in Inworld voice on the platform is now upgraded to Realtime TTS-2, Inworld's text-to-speech model.

TTS-2 is top-ranked on the Artificial Analysis leaderboard, an independent ranking where listeners compare voices blind and vote for the better one.

It supports 200+ languages and starts speaking in under 100 milliseconds, meaning roughly a tenth of a second passes between the text being ready and the first sound coming out.

It also takes natural-language direction, so developers can write plain instructions inside the script, like "yell at the top of your lungs with anger" or "slow down and speak with a warm whisper" and the model changes its pacing, tone, and emotion to match.

The longer-term goal is speech-to-speech: one system that listens, reasons, and speaks, rather than three separate steps handing off to each other.

来源:Rohan Paul · x.com