arXiv cs.AI· Gayoung Lee, Junho Kim, Jin-Hwa Kim, Junmo Kim·· 10 小时前AI 评分29
视觉中的皮格马利翁效应：用图像到黏土转换重建反光物体几何
Pygmalion Effect in Vision: Image-to-Clay Translation for Reflective Geometry Reconstruction
AI 导读
研究者提出“视觉中的皮格马利翁效应”框架，通过图像到黏土转换把反光物体“雕塑”成类黏土形态，以解耦外观与几何。该框架采用双分支设计：基于 BRDF 的反光分支与黏土引导分支共享同一高斯几何但走独立渲染路径，后者由合成黏土图像监督，提供无反射的几何引导。在合成与真实数据集上，几何与光度指标均获一致提升，论文已被 NeurIPS 2026 接收。
正文 · 原文
Abstract:Understanding reflection remains a long-standing challenge in 3D reconstruction due to the entanglement of appearance and geometry under view-dependent reflections. In this work, we present the Pygmalion Effect in Vision, a novel framework that metaphorically "sculpts" reflective objects into clay-like forms through image-to-clay translation. We then introduce a dual-branch design in which a BRDF-based reflective branch and a clay-guided branch share the same Gaussian geometry but operate through independent rendering paths. The clay-guided branch, supervised by the synthesized clay images, provides reflection-free geometric guidance that complements the photometric supervision of the BRDF branch. Experiments on both synthetic and real datasets show consistent improvements in both geometry and photometric metrics. Beyond technical gains, our framework reveals that seeing by unshining, translating radiance into neutrality, can serve as a powerful inductive bias for reflective object geometry learning.
| Comments: | Accepted at NeurIPS 2026 |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR) |
| Cite as: | arXiv:2511.21098 [cs.CV] |
| (or arXiv:2511.21098v2 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2511.21098 arXiv-issued DOI via DataCite |
Submission history
From: Gayoung Lee [view email]
[v1]
Wed, 26 Nov 2025 06:34:58 UTC (34,380 KB)
[v2]
Tue, 10 Nov 2026 07:28:17 UTC (16,326 KB)
来源：arXiv cs.AI · arxiv.org