arXiv cs.AI· Fei Wang, Baochun Li·· 1 天前AI 评分31
联邦学习中的恶意服务器梯度泄露:攻击难以兼顾有效性与隐蔽性
Hear No Evil: Detecting Gradient Leakage by Malicious Servers in Federated Learning
AI 导读
针对联邦学习中恶意服务器操纵全局模型以诱发信息丰富梯度更新的攻击,研究首次从防御者视角给出全面分析,发现这类攻击无法同时做到高效重建隐私数据与足够隐蔽以逃避检测,在包含常见归一化和联邦平均的真实 FL 设置下尤其如此。作者据此提出一种简单轻量的客户端检测机制,在本地训练开始前标记可疑模型更新,以极小开销为注重隐私的联邦学习系统提供可部署的防护。
正文 · 原文
Abstract:Recent work has shown that gradient updates in federated learning (FL) can unintentionally reveal sensitive information about a client's local data. This risk becomes significantly greater when a malicious server manipulates the global model to provoke information-rich updates from clients. In this paper, we adopt a defender's perspective to provide the first comprehensive analysis of malicious gradient leakage attacks and the model manipulation techniques that enable them. Our investigation reveals a core trade-off: these attacks cannot be both highly effective in reconstructing private data and sufficiently stealthy to evade detection -- especially in realistic FL settings that incorporate common normalization techniques and federated averaging.
Building on this insight, we argue that malicious gradient leakage attacks, while theoretically concerning, are inherently limited in practice and often detectable through basic monitoring. As a complementary contribution, we propose a simple, lightweight, and broadly applicable client-side detection mechanism that flags suspicious model updates before local training begins, despite the fact that such detection may not be strictly necessary in realistic FL settings. This mechanism further underscores the feasibility of defending against these attacks with minimal overhead, offering a deployable safeguard for privacy-conscious federated learning systems.
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC) |
| Cite as: | arXiv:2506.20651 [cs.LG] |
| (or arXiv:2506.20651v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2506.20651 arXiv-issued DOI via DataCite |
Submission history
From: Fei Wang [view email]
[v1]
Wed, 25 Jun 2025 17:49:26 UTC (3,475 KB)
来源:arXiv cs.AI · arxiv.org