SafeBranch：面向具身智能体的分支对安全对齐框架

View PDF HTML (experimental)

Abstract:Vision-language-model-based embodied agents can complete instructed tasks but often violate safety constraints in the process, a problem recently framed as interactive safety. Training such agents to act safely is difficult, since safety and task success are distinct objectives, and safety arises only at a small number of safety-critical steps within a trajectory. Standard supervision is insufficient: imitating safe trajectories teaches behavior without explaining why it is safe, and contrasting arbitrary safe and unsafe trajectories mixes the safety signal with unrelated differences. We propose SafeBranch, a framework that aligns an embodied actor on safety through branch pairs constructed from the actor's own unsafe rollouts via environment rollback. SafeBranch rolls each unsafe rollout back to the safety-critical step that caused the violation, queries the actor for a safe alternative, and pairs the original action with the alternative so that the two branches differ only at that step. The trained actor acts safely at deployment with no critic in the loop. On IS-Bench, SafetyALFRED, and out-of-distribution variants with unseen tasks and objects, it improves safe task completion, achieving roughly ten times more safe successes than the untrained baseline on the unseen-object variant. Project page: this https URL.

Submission history

From: Hyunse Lee [view email]
[v1] Thu, 20 Aug 2026 07:29:07 UTC (2,089 KB)
[v2] Tue, 13 Oct 2026 07:41:25 UTC (2,091 KB)