【论文速递】Trainspotting: Learning Object-Centric 3D Reconstruction from Found Photos

英文标题：Trainspotting: Learning Object-Centric 3D Reconstruction from Found Photos

arXiv编号：2611.06849
作者：Hanyu Chen, Noah Snavely
来源：arXiv
原文链接：https://arxiv.org/abs/2611.06849

中文摘要：
State-of-the-art feedforward reconstruction models perform poorly on in-the-wild object-centric photo collections. They are trained largely on single-session object captures whose images vary in viewpoint while the object and its environment remain nearly fixed. Public photo archives contain a different form of multi-view data. They hold found photos of the same object or design: photos taken independently by many people across years, environments, cameras, and sometimes physical units. In this work, we introduce Trainspotting, a dataset of 12,068 objects and 311,886 photos from Wikimedia Commons. We reconstruct each object to recover camera poses, multi-view stereo depth, and object masks. We categorize the objects into three regimes: objects fixed at one site, objects that move between sites, and designs shared by many physical units. Evaluating recent feedforward reconstruction models on Trainspotting shows that they fail most severely in the last two regimes. Fine-tuning VGGT-$Ω$ on Trainspotting significantly improves camera pose, depth, and 3D geometry on held-out objects. We observe similar improvements on the independent NAVI in-the-wild benchmark, which contains photos of each object in different environments. Performance on conventional benchmarks remains largely unchanged.

本文由华人空间 AI 论文助手自动抓取翻译，仅供学术交流。