跳到正文
arXiv:cs.AI· Wensi Ai, Christopher Luey, Karthik Dharmarajan, Evans Han, Yunfan Jiang, Stef Ren, Jianwen Xie, Jiajun Wu, Li Fei-Fei, Ruohan Zhang·· 23 小时前

I3L:面向全身移动操作迭代交互式模仿学习系统

I3L: Iterative Interactive Imitation Learning for Whole-Body Mobile Manipulation

AI 导读

硬件与学习系统 I3L 通过全身纠错与迭代策略精炼,解决长时程全身移动操作中离线策略的可靠性缺口。其开源 JoyLo+ 接口用手臂示教与触控接管实现跨部位协同纠错,在三种机器人本体、八个仿真与真实任务中,四轮 HG-DAgger 使自主成功率平均提升 68.3 个百分点,每任务成功率至少 90%,相同训练轨迹数下比纯示教训练高 35.6 个百分点;四轮后每回合接管时长下降 72%。

正文

View PDF HTML (experimental)

Abstract:Policies trained offline from teleoperated demonstrations can degrade outside their training distribution. This gap is particularly acute in long-horizon whole-body mobile manipulation, where long horizons amplify compounding errors and coordinated arm, torso, and base motion makes exhaustive demonstration coverage impractical. We introduce I3L, an integrated hardware and learning system that combines whole-body correction with iterative policy refinement to address this last-mile reliability gap. Its low-cost, open-source JoyLo+ interface uses policy-tracking leader arms and touch-triggered takeover to enable coordinated corrections across the body parts, while iterative deployment and retraining allow operators to target failures of the updated policy. We evaluate I3L across three robot embodiments and eight simulated and real-world tasks, including four long-horizon whole-body mobile manipulation tasks. Controlled simulation experiments show that four-round HG-DAgger achieves the highest final success on both tasks. Under this protocol, I3L improves autonomous success over the base policies by an average of 68.3 percentage points and achieves at least 90% success on every task, outperforming demonstration-only training by 35.6 percentage points on average with the same number of training trajectories. Averaged across tasks, takeover duration per episode decreases by 72% over four rounds. Together, these results show that I3L helps close the last-mile gap between offline training and reliable deployment and provides practical insights into collecting and using corrections for long-horizon whole-body mobile manipulation. Videos, visualizations, and appendix are at this https URL.
Comments: Project website: this https URL
Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.17748 [cs.RO]
  (or arXiv:2610.17748v1 [cs.RO] for this version)
  https://doi.org/10.48550/arXiv.2610.17748

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Wensi Ai [view email]
[v1] Tue, 13 Oct 2026 05:28:59 UTC (5,437 KB)

来源:arXiv:cs.AI · arxiv.org