arXiv:cs.AI· Ziyi Wang, Junchi Yao, Heqian Qiu, Wenbo Shi, Chengjiu Wang, Jinyang He, Binkai Hong, Hongliang Li·· 4 小时前AI 评分33
Weave Forcing:面向交互式长视频生成的组合式记忆路由框架
Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation
AI 导读
Weave Forcing 是一个免训练框架,用于交互式长视频生成中的组合式记忆复用。它先用 LLM 做语义槽路由,把用户提示词拆解为角色与背景描述并分别为各组件挑选历史参考,再通过掩码记忆编织和覆盖自适应 RoPE 选择性暴露压缩历史 KV 记忆中的相关 token。实验显示该方法提升了跨镜头主体与背景一致性,同时保持有竞争力的视觉质量与文本对齐。
正文
Abstract:Recent advances in autoregressive video generation have improved temporal consistency over extended durations, yet interactive storytelling requires more than continuous scene extension: a new shot may combine characters and backgrounds from different historical shots. Whole prompt retrieval can overlook the distinct reference needs of individual components, while directly combining all historical memories may introduce unrelated visual content. To address these problems, we present Weave Forcing, a training-free framework for compositional memory reuse in interactive long video generation. First, we use an LLM for semantic slot routing to decompose user prompts into character and background descriptions and explicitly select suitable historical references for each component. To isolate the required content, masked memory weaving uses contrasting attention maps conditioned on semantic slots to construct refined semantic masks, selectively exposing relevant tokens from compressed historical KV memories to guide the generation of the current shot. We further introduce coverage adaptive RoPE to adjust temporal offsets and memory retention according to no, partial, or full reference coverage, addressing visual artifacts observed when incomplete historical references are positioned close to the current generation. Extensive experiments demonstrate that Weave Forcing improves cross-shot subject and background consistency while maintaining competitive visual quality and text alignment.
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.03510 [cs.CV] |
| (or arXiv:2610.03510v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2610.03510 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Ziyi Wang [view email]
[v1]
Fri, 2 Oct 2026 16:04:26 UTC (9,611 KB)
来源:arXiv:cs.AI · arxiv.org