arXiv:cs.AI· Sangeyl Lee, Seunghyun Shin, Seungho Park, Wooseok Jeon, Hae-Gon Jeon·· 5 小时前
WeLike2Party:无需显式姿态提取的多人物图像动画上下文动作迁移
WeLike2Party! In-Context Motion Transfer for Multi-Human Image Animation
AI 导读
WeLike2Party 是一个基于直接上下文视频条件的多人物动画框架,推理时无需显式提取姿态或网格,并引入 Reference Asymmetric RoPE Conditioning 与 Identity Binding Supervision 来保持外观细节和身份-动作绑定。
正文
Abstract:Human image animation aims to transfer motion from a driving video to subjects in a reference image. Despite remarkable progress in video generation, achieving high-fidelity animation of multiple interacting subjects remains a challenge. Many existing approaches rely on explicit motion representations such as 2D skeletons or parametric body meshes and struggle to preserve identity-motion binding under inter-person occlusion. To address this limitation, we propose WeLike2Party, a multi-human animation framework built on direct in-context video conditioning without explicit pose or mesh extraction at inference. We further introduce Reference Asymmetric RoPE Conditioning to preserve fine-grained appearance details, and Identity Binding Supervision to associate each reference identity with its intended motion trajectory. To support cross-identity training, we construct MotionTwin, a large-scale synthetic dataset comprising 14.4K cross-identity video pairs with shared subject and camera motions, totaling 84.3 hours of photorealistic video. We additionally present MotionTwin-Bench, a cross-identity benchmark specifically designed to evaluate subject-level visual fidelity and identity-motion binding. Extensive experiments on MotionTwin-Bench and real-world videos demonstrate that WeLike2Party outperforms recent state-of-the-art methods in subject-level visual fidelity, identity-motion binding, and overall perceptual quality, particularly in multi-person interactions with substantial occlusion.
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2609.36937 [cs.CV] |
| (or arXiv:2609.36937v2 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2609.36937 arXiv-issued DOI via DataCite |
Submission history
From: Seunghyun Shin Mr [view email]
[v1]
Tue, 29 Sep 2026 07:50:05 UTC (25,028 KB)
[v2]
Tue, 13 Oct 2026 07:05:17 UTC (25,028 KB)
来源:arXiv:cs.AI · arxiv.org