【论文速递】SM4RT: Cascaded Feed-forward Model for 4D Reconstruction

英文标题：SM4RT: Cascaded Feed-forward Model for 4D Reconstruction

arXiv编号：2611.08436
作者：Pang-Chi Lo, Jhao-Syun Lai, Tsung-Wei Ke
来源：arXiv
原文链接：https://arxiv.org/abs/2611.08436

中文摘要：
We introduce SM4RT, a multi-task cascade feed-forward model for dynamic scene reconstruction from RGB videos. While existing feed-forward approaches typically address geometry reconstruction and motion estimation separately--and often predict motions in a single coordinate frame that must account for camera movement--SM4RT solves these tasks sequentially by first reconstructing 3D geometry and then bootstrapping motion estimation from the predicted structure. By expressing each pixel's 3D motion in its corresponding camera frame, SM4RT reduces ambiguity arising from camera motion. To address the sparsity of real-world motion labels, SM4RT further incorporates a weakly supervised loss that regularizes unlabeled point motions using labeled point positions at the other time step. We evaluate motion estimation on three dynamic-scene datasets--Kubric, Waymo, and Point Odyssey--and SM4RT achieves the best performance on most metrics compared with prior baselines. We additionally benchmark geometry reconstruction on five dynamic scene datasets and show that SM4RT achieves competitive performance with state-of-the-art methods. Overall, our unified framework demonstrates that combining geometry reconstruction and motion estimation in a cascade not only avoids performance trade-offs but also enhances motion estimation through improved geometric reasoning.

本文由华人空间 AI 论文助手自动抓取翻译，仅供学术交流。