跳到正文
arXiv cs.AI· Manav Kulshrestha, Shreyans Jain, Apoorva Vashisth, Ankush Gupta, Damon Conover, Aniket Bera·· 10 小时前AI 评分31

LAGR:面向任务抓取的语言感知抓取重排序方法

LAGR: Language-Aware Grasp Re-Ranking for Task Oriented Grasping

AI 导读

LAGR 是一种面向任务抓取的语言感知抓取重排序方法,先由视觉-语言输入生成任务无关的抓取候选及物理可行性分数,再用语言条件重排序器对所有候选联合打分。作者构建了覆盖 100,911 个图像-任务对、17 个物体类别的 268 万条 5-DoF 抓取标注数据集,LAGR 比次优方法高出 9.3 个百分点,并在 Franka Research 3 机器人上完成真实物体任务抓取验证。

正文 · 原文

View PDF HTML (experimental)

Abstract:Grasping is a fundamental capability for robotic manipulation, with the appropriate grasp depending on the downstream task. For example, a hammer should be held by its handle for hammering but by its head when it is handed over. Selecting such a grasp requires consideration of two criteria: physical feasibility on the object and suitability for the task. Developing such an approach requires dense grasp labels with both feasibility and task scores on real observations, but existing task-oriented grasping datasets are small, synthetic, or costly to annotate. To address this gap, we construct a dataset of 2.68 million scored 5-DoF grasp annotations over 100,911 image-task pairs from $17$ object categories. Additionally, we introduce LAGR, a task-oriented grasp detection method that explicitly addresses both these challenges. Given vision-language inputs, LAGR first generates task-independent grasp proposals along with a physical feasibility score, and then scores the generated grasps with a language-conditioned re-ranker that reasons over all proposals jointly. Experiments show that LAGR outperforms the next best method by 9.3 percentage points. We further validate LAGR on real objects by executing task-oriented grasps with a Franka Research 3 robot.
Comments: Manav Kulshrestha and Shreyans Jain contributed equally to this work
Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2611.23858 [cs.RO]
  (or arXiv:2611.23858v1 [cs.RO] for this version)
  https://doi.org/10.48550/arXiv.2611.23858

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Manav Kulshrestha [view email]
[v1] Wed, 18 Nov 2026 05:04:12 UTC (9,727 KB)

来源:arXiv cs.AI · arxiv.org