跳到正文
ModelScope· @ModelScope2022 · X·· 6 小时前AI 评分43
AI 导读

TaoMate-H3-FL2VA 为 MiniMax H3 带来 3 步流式音视频生成,480p 基准下 DiT 推理提速 11.45×、首个可播放视频时间提速 10.6×。

正文

TaoMate-H3-FL2VA brings 3-step streaming audio-video generation to MiniMax H3. The TaoMate-H3 runtime reports 11.45× faster DiT inference and 10.6× faster time to first playable video than the original MiniMax H3 pipeline in its 480p benchmark.
🤖 https://modelscope.ai/models/TaoLiveAIGC/TaoMate-H3-FL2VA
📄 https://modelscope.ai/papers/2607.24359

⚡ 11.45× faster DiT: Generates a 10-second 480p sample in 14.8 seconds of DiT time, compared with 169.6 seconds for the original MiniMax H3 pipeline in the reported setup.
▶️ Earlier playback: Produces the first playable video in about 17.3 seconds, a 10.6× improvement over the baseline.
🔊 Synchronized by design: Generates speech, sound, and video together on one timeline instead of assembling them afterward.
🎬 Continuous generation: Processes prompts in five-second blocks while preserving visual identity, voice, and motion across prompt changes. Supports portrait and landscape output at 480p, 768p, and aligned 1080p.
📜 A three-step LoRA for the MiniMax H3 FL2VA base model. MiniMax H3 Community License Agreement applies.

来源:ModelScope · x.com