arXiv cs.CL· Rajdeep Pandhare, Rohit Kundaikar, Yakub Kojar, Shreyansh Tiwari·· 2 天前AI 评分18
MeddeX：结合 RAG 与 Gemini Vision 的 LLaMA-3 医学报告分析系统
MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis
AI 导读
MeddeX 将 QLoRA 微调的 LLaMA-3（8B）与 RAG 及多模态 Gemini Vision 层结合，为医学报告生成有证据支撑的摘要，支持文本 PDF、扫描件和放射影像。
正文 · 原文
Abstract:Modern healthcare generates increasingly complex medical reports that challenge clinical professionals in terms of time and interpretive burden. Manual review processes are slow, error-prone, and difficult to scale. This paper presents MeddeX, a Medical Report Analyzer that combines a QLoRA fine-tuned LLaMA-3 (8B) model with Retrieval-Augmented Gen eration (RAG) and a multimodal Gemini Vision layer to deliver accurate, concise, and evidence-backed summaries of medical documents. The system handles text-native PDFs, scanned image based PDFs, and direct radiological images through an intelligent hybrid extraction pipeline that includes a novel garbage-text detection mechanism for corrupted and UTF-16-encoded doc uments. Beyond single-report Q&A, MeddeX introduces report scoped retrieval for precise contextual grounding, an automated longitudinal report comparison engine, and a self-healing backfill pipeline that lazily processes legacy documents on demand. A FastAPI backend, Supabase vector store, and this http URL fron tend complete the end-to-end architecture. Evaluation against the base LLaMA3-Med42-8B model demonstrates consistent improvements across ROUGE-1 (+9.2%), ROUGE-2 (+10.0%), ROUGE-L (+11.8%), BLEU (+71.4%), and BERTScore (+0.8%), validating the benefit of domain-specific fine-tuning. MeddeX represents a practical and robust step toward AI-assisted clinical decision support.
| Comments: | 6 pages , 3 figures, published in ijsrem |
| Subjects: | Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV) |
| ACM classes: | I.2.7; I.2.10; H.3.3 |
| Cite as: | arXiv:2610.20632 [cs.CL] |
| (or arXiv:2610.20632v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.20632 arXiv-issued DOI via DataCite |
|
| Journal reference: | IJSREM, International Journal of Scientific Research in Engineering and Management Volume 10 | 4| April 2026 |
Submission history
From: Rajdeep Pandhare [view email]
[v1]
Wed, 30 Sep 2026 13:27:05 UTC (41 KB)
来源：arXiv cs.CL · arxiv.org