arXiv cs.AI· Lada Kudl\'a\v{c}kov\'a·· 12 小时前AI 评分22
面向自闭症教育的类人机器人视觉任务建模与自动规划
Visual Task Modeling and Automated Planning for Humanoid Robots in Education of Individuals with Autism Spectrum Disorder
AI 导读
研究提出一种让配备摄像头的半自主机器人识别任务目标并规划动作的方法，聚焦自闭症谱系障碍（ASD）教育中常用的 Shoebox Tasks。其求解器用基于视觉的大语言模型将任务照片转换为 PDDL 表示并生成动作计划，Nao 机器人可自主执行任务，并通过动作演示、语音指令或手势提示下一步或报告检测到的失败。教师无需编程，求解器仅以拍摄图像为输入，经适配后可集成到多种教育机器人中。
正文 · 原文
Abstract:In robot-assisted education, a robot must understand how to complete a task in order to effectively guide a student through it. We present a novel method that enables a semi-autonomous, camera-equipped robot to recognise the task goal and plan actions to achieve it. Our work focuses on Shoebox Tasks, an activity commonly used in the education of individuals with Autism Spectrum Disorder (ASD). These tasks are designed so that the goal can be inferred directly from their visual structure. We have developed a solver that uses a vision-based Large Language Model to convert photos of a Shoebox Task into a Planning Domain Definition Language (PDDL) representation and generate action plans for solving it. We have also implemented a robotic interface that enables a Nao robot to autonomously execute various Shoebox Tasks and assist a student by suggesting next steps or signalling detected failures through action demonstrations, voice commands, or gestures. With an adapted robotic interface, the solver can be integrated into a variety of educational robots. No programming expertise is required from teachers, and the solver operates exclusively on captured images as input. Research in special educational needs indicates that students with ASD can benefit substantially from robot-assisted teaching, and our system aims to strengthen these learning opportunities while also fostering interest in robotics among individuals with ASD.
| Comments: | 6 pages, presented at conference AICCONF 2026 in Prague, Czech Republic |
| Subjects: | Robotics (cs.RO); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.27162 [cs.RO] |
| (or arXiv:2610.27162v1 [cs.RO] for this version) | |
| https://doi.org/10.48550/arXiv.2610.27162 arXiv-issued DOI via DataCite (pending registration) |
|
| Related DOI: | https://doi.org/10.1109/AICCONF69182.2026.11600719
DOI(s) linking to related resources |
Submission history
From: Lada Kudláčková [view email]
[v1]
Mon, 19 Oct 2026 18:57:19 UTC (2,047 KB)
来源：arXiv cs.AI · arxiv.org