arXiv cs.CL· Adeleke Adeniyan, Abimbola H. Afolayan, Olanrewaju V. Johnson·· 12 小时前AI 评分31
面向尼日利亚手语字母数字手势离线识别的边缘优化 YOLOv11n 架构
Edge-Optimized YOLOv11n Architecture for Offline Recognition of Nigerian Sign Language Alphanumeric Gestures
AI 导读
研究提出轻量级 YOLO11n 目标检测框架，在 RAM 仅 1GB 至 4GB 的普通手机上实现尼日利亚手语字母数字手势的实时离线识别。团队构建含 11,208 张原始手势图像、33 个静态类别、5 位手语者的基准数据集，增强后训练集达 23,509 张，验证集与测试集各 1,681 张。
正文 · 原文
Abstract:Deaf inclusion across sub-Saharan society faces regional hurdles, with Nigeria as the core empirical focus. Existing recognition models demand heavy computational infrastructure. However, standard mobile phones used locally rarely exceed 1 GB to 4 GB of RAM. This study addresses constraints through a lightweight YOLO11n object-detection framework. The system provides real-time Nigerian Sign Language recognition for low-resource hardware. A benchmark dataset containing 11,208 raw gesture images was established. The data spans 33 static classes collected from five signers. Partitioning isolates signers S1 through S3 for training. Signer S4 provides validation data. Signer S5 is reserved for testing. Spatial augmentations are restricted strictly to the training set. This yields 23,509 training images. The validation and test sets each maintain 1,681 images across varied environments. The framework integrates a quantization-aware compression objective. Loss functions merge with squared Frobenius-norm penalties to govern weight distortion. A Spatial-Density Occlusion Index quantifies background complexity and self-occlusion. A latency-profiling equation relates floating-point operations and memory bandwidth to chipset clock speed. Performance testing on physical Android hardware utilizes unquantized FP32 weights. Mean inference latencies span 405.5 ms to 1,759.4 ms. Measured against test data, the algorithm attains a Precision of 0.9975. Recall reaches 0.9991. Mean Average Precision is 0.9942. Outcomes support offline functionality on constrained mobile devices. Practical deployment operates through a mobile utility using CameraX. The application captures gestures in real time. Recognized signs display as text instantly.
| Comments: | 12 pages, 6 figures, 7 tables |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL) |
| Cite as: | arXiv:2611.00025 [cs.CV] |
| (or arXiv:2611.00025v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2611.00025 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Adeleke Adeniyan [view email]
[v1]
Sat, 3 Oct 2026 19:15:16 UTC (1,097 KB)
来源：arXiv cs.CL · arxiv.org