arXiv cs.AI· Qianxu Wang, Shengmiao Samuel Jin, Kuan Fang·· 13 小时前AI 评分38
KITE:解耦运动学与交互,实现零样本跨具身操作
KITE: Decoupling Kinematics and Interaction for Zero-Shot Cross-Embodiment Manipulation
AI 导读
KITE 将操作任务解耦为与具身无关的交互意图预测和具身相关的运动学解码,仅用源机器人演示数据训练交互策略,再借助各具身的运动学模型生成合成数据训练解码器。在仿真与真实世界的四项操作任务中,KITE 实现了对平行夹爪、灵巧手和复合具身的零样本迁移,并持续优于 SOTA 基线。
正文 · 原文
Abstract:Generalizing manipulation policies across robot embodiments remains difficult because standard policies tie the interactions needed for a task to the actions of a particular robot. We study zero-shot cross-embodiment manipulation, where a policy trained on source embodiments must be deployed on a structurally different target embodiment without additional task demonstrations. We introduce Kinematic Interaction Transfer across Embodiments (KITE), which decouples manipulation into embodiment-agnostic interaction prediction and embodiment-specific kinematic decoding, connected through a learned representation of interaction intent based on contact patterns. An interaction policy is trained to predict the intent using demonstration data only collected on a source robot, and shared across morphologically different target robots. A kinematic decoder realizes these intents by learning from synthetic data generated from each embodiment's kinematic model. Through such decoupling, KITE can robustly transfer learned skills to a new embodiment given only its kinematic model, without recollecting any task-specific demonstration data. We evaluate KITE on four manipulation tasks in simulation and the real world spanning transfer between parallel grippers, dexterous hands, and composite embodiments. KITE successfully achieves zero-shot transfer to structurally different target embodiments, and consistently outperforms state-of-the-art baselines. Project website: this https URL.
| Comments: | 13 pages, including appendix. Project website: this https URL |
| Subjects: | Robotics (cs.RO); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2606.22113 [cs.RO] |
| (or arXiv:2606.22113v2 [cs.RO] for this version) | |
| https://doi.org/10.48550/arXiv.2606.22113 arXiv-issued DOI via DataCite |
Submission history
From: Qianxu Wang [view email]
[v1]
Sat, 20 Jun 2026 15:51:30 UTC (12,906 KB)
[v2]
Tue, 20 Oct 2026 16:14:34 UTC (38,124 KB)
来源:arXiv cs.AI · arxiv.org