ElevenLabs 发布新的强制对齐模型 Cue,可将转录文本的每个字符精确放到音频时间轴上。官方称在基准覆盖的 29 种语言中精度超过其测试的所有开源对齐器,单 GPU 约半秒即可对齐一小时音频,且任意长度录音可单次处理。Cue 已支撑 ElevenLabs 全部 Speech to Text 转录,并可通过 Forced Alignment API 单独使用。
New from ElevenLabs research: Today we’re sharing more about Cue, our new forced alignment model. It places every character on the audio timeline with more precision than any other aligner we tested. That means the right words show up at the right time.
Forced alignment is the step that turns a transcript into timestamps. It’s how subtitles land on time, how dubbed lines match the speaker, and how clicking a word in a transcript jumps to the moment it was said. Most open-source aligners are built for short, clean clips in a limited set of languages. Cue is one model that handles recordings of any length in a single pass. On real-world audio, it was more accurate than every open-source aligner we tested in all 29 languages of our benchmark. It aligns an hour of audio in about half a second on one GPU.
Cue already powers every Speech to Text transcription on ElevenLabs, and it’s available on its own through the Forced Alignment API.
Read the full post: https://elevenlabs.io/blog/cue-aligner
来源:ElevenLabs · x.com