arXiv cs.AI· Hamid Sarmadi, Ola Hall, Thorsteinn R\"ognvaldsson, Mattias Ohlsson·· 11 小时前AI 评分31
利用 ChatGPT 多模态视觉能力按贫困等级排序卫星图像：推进社会科学研究工具
Leveraging ChatGPT's Multimodal Vision Capabilities to Rank Satellite Images by Poverty Level: Advancing Tools for Social Science Research
AI 导读
研究显示，ChatGPT 可通过成对比较方式按贫困等级对卫星图像排序，准确率与基于人类专家标注图像特征训练的模型相当，并优于此前报道的专家直接财富分类。该研究探讨了视觉 LLM 在村级贫困预测中的可解释性与可扩展性，同时提出 DHS 等公开数据集因位置坐标加噪而影响财富指数获取的可靠性问题。代码与数据已公开。
正文 · 原文
Abstract:This paper investigates the novel application of Large Language Models (LLMs) with vision capabilities to analyze satellite imagery for village-level poverty prediction. Although LLMs were originally designed for natural language understanding, their adaptability to perform multimodal tasks, including geospatial analysis, has opened new frontiers in data-driven research. By leveraging advancements in vision-enabled LLMs, we assess their ability to provide interpretable, scalable, and reliable insights into human poverty from satellite images. Using a pairwise comparison approach, we demonstrate that ChatGPT can rank satellite images based on poverty levels with an accuracy comparable to a model trained on human-expert-identified image features and better than direct expert wealth classifications reported previously. These findings highlight both the promise and the limitations of LLMs in socioeconomic research, providing a foundation for their integration into poverty assessment workflows. This study contributes to the ongoing exploration of unconventional data sources for welfare analysis and opens pathways for cost-effective, large-scale poverty monitoring. Our results also put forward the question of how reliable public datasets, such as DHS, are for retrieving wealth indices that are anonymized by adding noise to the location coordinates. The code and data used for the analyses in this paper are publicly available.
| Comments: | Extra experiments are added to the paper and the repository analyzing the quality of comparisons |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2501.14546 [cs.CV] |
| (or arXiv:2501.14546v4 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2501.14546 arXiv-issued DOI via DataCite |
Submission history
From: Hamid Sarmadi [view email]
[v1]
Fri, 24 Jan 2025 14:49:00 UTC (11,865 KB)
[v2]
Wed, 22 Jul 2026 15:44:08 UTC (11,827 KB)
[v3]
Tue, 28 Jul 2026 14:57:28 UTC (11,827 KB)
[v4]
Thu, 5 Nov 2026 15:47:58 UTC (11,834 KB)
来源：arXiv cs.AI · arxiv.org