Data-driven structural priors for shape completion

ACM Transactions on Graphics - Tập 34 Số 6 - Trang 1-11 - 2015
Minhyuk Sung1, Vladimir G. Kim2, Roland Angst3, Leonidas Guibas1
1Stanford University
2Stanford University and Adobe Research#TAB#
3Stanford University and Max Planck Institute for Informatics#TAB#

Tóm tắt

Acquiring 3D geometry of an object is a tedious and time-consuming task, typically requiring scanning the surface from multiple viewpoints. In this work we focus on reconstructing complete geometry from a single scan acquired with a low-quality consumer-level scanning device. Our method uses a collection of example 3D shapes to build structural part-based priors that are necessary to complete the shape. In our representation, we associate a local coordinate system to each part and learn the distribution of positions and orientations of all the other parts from the database, which implicitly also defines positions of symmetry planes and symmetry axes. At the inference stage, this knowledge enables us to analyze incomplete point clouds with substantial occlusions, because observing only a few regions is still sufficient to infer the global structure. Once the parts and the symmetries are estimated, both data sources, symmetry and database, are fused to complete the point cloud. We evaluate our technique on a synthetic dataset containing 481 shapes, and on real scans acquired with a Kinect scanner. Our method demonstrates high accuracy for the estimated part structure and detected symmetries, enabling higher quality shape completions in comparison to alternative techniques.

Từ khóa


Tài liệu tham khảo

10.1023/A:1010933404324

10.1145/2010324.1964930

Choi S. Zhou Q.-Y. and Koltun V. 2015. Robust reconstruction of indoor scenes. CVPR. Choi S. Zhou Q.-Y. and Koltun V. 2015. Robust reconstruction of indoor scenes. CVPR.

10.1007/s002360050075

Felzenszwalb P. McAllester D. and Ramanan D. 2008. A discriminatively trained multiscale deformable part model. In IEEE CVPR 1--8. Felzenszwalb P. McAllester D. and Ramanan D. 2008. A discriminatively trained multiscale deformable part model. In IEEE CVPR 1--8.

10.1145/2601097.2601185

10.1016/j.cag.2009.03.010

10.1109/TPAMI.2008.65

10.1111/j.1467-8659.2012.03175.x

10.1145/2024156.2024159

10.1145/2601097.2601111

Janoch , A. , Karayev , S. , Jia , Y. , Barron , J. , Fritz , M. , Saenko , K. , and Darrell , T . 2011. A category-level 3-d object dataset: Putting the kinect to work . In ICCV Workshop on Consumer Depth Cameras in Computer Vision, 1168--1174 . Janoch, A., Karayev, S., Jia, Y., Barron, J., Fritz, M., Saenko, K., and Darrell, T. 2011. A category-level 3-d object dataset: Putting the kinect to work. In ICCV Workshop on Consumer Depth Cameras in Computer Vision, 1168--1174.

10.1145/1833349.1778839

10.1145/2185520.2185551

10.1145/2487228.2487237

10.1145/2366145.2366157

10.1145/2461912.2461933

10.1111/cgf.12225

10.1145/2601097.2601117

10.1109/TPAMI.2006.200

Lai , K. , Bo , L. , Ren , X. , and Fox , D . 2011. A large-scale hierarchical multi-view rgb-d object dataset . In IEEE ICRA , 1817--1824. Lai, K., Bo, L., Ren, X., and Fox, D. 2011. A large-scale hierarchical multi-view rgb-d object dataset. In IEEE ICRA, 1817--1824.

10.1111/cgf.12573

10.1145/2661229.2661243

10.1109/3DV.2014.108

10.1109/CVPR.2013.33

10.1145/1179352.1141924

10.1111/cgf.12010

10.1145/2366145.2366156

Pauly M. Mitra N. J. Giesen J. Gross M. and Guibas L. 2005. Example-based 3d scan completion. SGP. Pauly M. Mitra N. J. Giesen J. Gross M. and Guibas L. 2005. Example-based 3d scan completion. SGP.

10.1145/1360612.1360642

10.1145/1141911.1141923

10.1145/2661229.2661288

10.1145/2366145.2366199

10.1145/2024156.2024160

10.1007/978-3-642-33715-4_54

10.1111/cgf.12481

10.1109/ICCV.2005.221

10.1007/s10107-004-0559-y

10.1145/2366145.2366184

Wu C. Lenz I. and Saxena A. 2014. Hierarchical semantic labeling for task-relevant rgb-d perception. RSS. Wu C. Lenz I. and Saxena A. 2014. Hierarchical semantic labeling for task-relevant rgb-d perception. RSS.

Xie Z. Xu K. Liu L. and Xiong Y. 2014. 3d shape segmentation and labeling via extreme learning machine. SGP. Xie Z. Xu K. Liu L. and Xiong Y. 2014. 3d shape segmentation and labeling via extreme learning machine. SGP.

10.1145/1882261.1866206

Xu K. Zhang H. Cohen-Or D. and Chen B. 2012. Fit and diverse: Set evolution for inspiring 3d shape galleries. 57:1--57:10. Xu K. Zhang H. Cohen-Or D. and Chen B. 2012. Fit and diverse: Set evolution for inspiring 3d shape galleries. 57:1--57:10.

10.1145/2661229.2661234

10.1109/CVPR.2014.38

10.1145/1778765.1778831

10.1111/cgf.12039

Thông tin
Thông tin xuất bản

ACM Transactions on Graphics

Tập 34 Số 6

1-11

Thông tin tác giả