arXiv cs.AI· Asiri Gawesha Lindamulage, Sanka Mohottala, Dharshana Kasthurirathna, Nuwan Kodagoda·· 11 小时前AI 评分22
STAG-Net：基于关键点组结构感知注意力的轻量头部姿态估计
STAG-Net: Structure-Aware Attention over Landmark Groups for Lightweight Head Pose Estimation
AI 导读
STAG-Net 通过面部关键点组上的结构感知注意力实现轻量头部姿态估计，在所有对比的基于关键点方法中取得最低平均绝对误差。其 FAN 变体在 BIWI 有效检测帧上跨数据集评估误差为 3.51°、受试者独立评估为 2.39°，回归器仅 0.012-0.043M 参数、24.1-83.6K FLOPs，比 FSA-Net 少约三个数量级。
正文 · 原文
Abstract:Head pose estimation is important for human computer interaction and driver monitoring, but many image based methods remain too costly for resource constrained deployment. We propose STAG-Net, a structure-aware attention over landmark groups for lightweight head Pose estimation that estimates head pose from facial landmarks using movement aware selection, spatial clustering, compact DeepSet encoders, self attention, and a global geometry descriptor. We develop variants using FaceMesh and Face Alignment Network landmarks and evaluate them under cross dataset and subject independent protocols on 300W-LP, AFLW2000, and BIWI. STAG-Net achieves the lowest mean absolute error among all compared landmark based methods in every evaluated setting. On BIWI frames with valid detections, the FAN variant also records the lowest overall error among all compared methods, reaching $3.51^\circ$ under cross dataset evaluation and $2.39^\circ$ under subject independent evaluation. The regressors use only 0.012 to 0.043 million parameters and 24.1 to 83.6 thousand FLOPs, about three orders of magnitude fewer FLOPs than FSA-Net. Despite including landmark extraction and regression, the FaceMesh pipeline reaches 322.9 frames per second on a Tesla T4 GPU, nearly twice the 164.5 frames per second of the fastest measured image based baseline, and 111.0 frames per second on CPU. After normalization by dataset size, STAG-Net processes training samples seven to eight times faster than FSA-Net and more than one hundred times faster than HopeNet and TokenHPE, while complete training finishes within 28 minutes. These results show that STAG-Net combines leading landmark based accuracy with substantially lower training and inference cost.
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC) |
| Cite as: | arXiv:2611.07828 [cs.CV] |
| (or arXiv:2611.07828v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2611.07828 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Asiri Gawesha Lindamulage [view email]
[v1]
Thu, 5 Nov 2026 11:09:34 UTC (4,508 KB)
来源：arXiv cs.AI · arxiv.org