MultiFair：双层级梯度调制实现多模态医学分类的均衡公平性

View PDF HTML (experimental)

Abstract:Medical decision systems increasingly rely on data from multiple sources to ensure reliable and unbiased diagnosis. However, existing multimodal learning models fail to achieve this goal because they often overlook two critical challenges. First, various data modalities may learn unevenly, thereby converging to a model biased towards certain modalities. Second, the model may emphasize learning on certain demographic groups causing unfair performances. The two aspects can influence each other, as different data modalities may favor respective groups during optimization, leading to both imbalanced and unfair multimodal learning. This paper proposes a novel approach called MultiFair for multimodal medical classification, which addresses these challenges with a dual-level gradient modulation process. MultiFair dynamically modulates training gradients regarding the optimization direction and magnitude at both data modality and group levels. We evaluate MultiFair on three real-world medical classification datasets with diverse demographic attributes,including multiclass classification and missing-modality settings. Experimental results demonstrate its effectiveness.

Comments:	This work has been accepted for publication in IEEE Transactions on Medical Imaging
Subjects:	Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)
Cite as:	arXiv:2510.07328 [cs.LG]
	(or arXiv:2510.07328v3 [cs.LG] for this version)
	https://doi.org/10.48550/arXiv.2510.07328 arXiv-issued DOI via DataCite

Submission history

From: Md Zubair [view email]
[v1] Tue, 30 Sep 2025 20:30:12 UTC (3,389 KB)
[v2] Thu, 9 Jul 2026 05:29:24 UTC (606 KB)
[v3] Tue, 27 Oct 2026 16:31:14 UTC (606 KB)