Free-viewpoint image based rendering with multi-layered depth maps

Optics and Lasers in Engineering - Tập 147 - Trang 106726 - 2021
Honglin Yuan1,2, Remco C. Veltkamp2
1School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, Jiangsu Province 210044, China
2Department of Information and Computing Sciences, Utrecht University, Utrecht 3584CC, The Netherlands

Tài liệu tham khảo

Fehn, 2004, Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3d-tv, 5291, 93 Li, 2018, Hole filling with multiple reference views in DIBR view synthesis, IEEE Trans Multimedia, 20, 1948, 10.1109/TMM.2018.2791810 Mori, 2009, View generation with 3D warping using depth information for FTV, Signal Process Image Commun, 24, 65, 10.1016/j.image.2008.10.013 Chaurasia, 2013, Depth synthesis and local warps for plausible image-based navigation, ACM Transactions on Graphics (TOG), 32, 30, 10.1145/2487228.2487238 Lei, 2017, A divide-and-conquer hole-filling method for handling disocclusion in single-view rendering, Multimed Tools Appl, 76, 7661, 10.1007/s11042-016-3413-3 Dai, 2017, View synthesis with hierarchical clustering based occlusion filling, 1387 Liu, 2016, View synthesis with 3D object segmentation-based asynchronous blending and boundary misalignment rectification, Vis Comput, 32, 989, 10.1007/s00371-016-1228-x Zinger, 2010, Free-viewpoint depth image based rendering, J Vis Commun Image Represent, 21, 533, 10.1016/j.jvcir.2010.01.004 Shum, 2008 Zitnick, 2007, Stereo for image-based rendering using image over-segmentation, Int J Comput Vis, 75, 49, 10.1007/s11263-006-0018-8 Tereshin, 2020, Automatically controlled morphing of 2d shapes with textures, SIAM J Imaging Sci, 13, 78, 10.1137/19M1241581 Wang, 2019, Robust view synthesis in wide-baseline complex geometric environments, 2297 Buyssens, 2015, Superpixel-based depth map inpainting for RGB-D view synthesis, 4332 Ortiz-Cayon, 2015, A Bayesian approach for selective image-based rendering using superpixels, 469 Hedman, 2016, Scalable inside-out image-based rendering, ACM Transactions on Graphics (TOG), 35, 231, 10.1145/2980179.2982420 Penner, 2017, Soft 3d reconstruction for view synthesis, ACM Trans Graph, 36, 235:1, 10.1145/3130800.3130855 Flynn, 2016, Deepstereo: Learning to predict new views from the world’s imagery, 5515 Xia, 2018, Gibson env: Real-world perception for embodied agents, 9068 Mildenhall, 2019, Local light field fusion: practical view synthesis with prescriptive sampling guidelines, ACM Transactions on Graphics (TOG), 10.1145/3306346.3322980 Zhou, 2018, Stereo magnification: Learning view synthesis using multiplane images, 65:1 Srinivasan, 2017, Learning to synthesize a 4D RGBD light field from a single image, 2243 Flynn, 2019, Deepview: View synthesis with learned gradient descent, 2367 Ni, 2019, Unsupervised dense light field reconstruction with occlusion awareness, Comput Graph Forum, 38, 425, 10.1111/cgf.13849 Schmeing, 2015, Faithful disocclusion filling in depth image based rendering using superpixel-based inpainting, IEEE Trans Multimedia, 17, 2160, 10.1109/TMM.2015.2476372 Bertalmio, 2000, Image inpainting, 417 Solh, 2012, Hierarchical hole-filling for depth-based view synthesis in FTV and 3D video, IEEE J Sel Top Signal Process, 6, 495, 10.1109/JSTSP.2012.2204723 Chen, 2005, Efficient depth image based rendering with edge dependent depth filter and interpolation, 1314 Sinha, 2009, Piecewise planar stereo for image-based rendering, 1881 Goesele, 2010, Ambient point clouds for view interpolation, 29, 95 Bleyer, 2011, Patchmatch stereo-stereo matching with slanted support windows., 11, 1 Ma, 2013, Constant time weighted median filtering for stereo matching and beyond, 49 Arias-Castro, 2009, Does median filtering truly preserve edges better than linear filtering?, The Annals of Statistics, 37, 1172, 10.1214/08-AOS604 Zitnick, 2004, High-quality video view interpolation using a layered representation, ACM Trans Graph, 23, 600, 10.1145/1015706.1015766 Alhashim, 2018, High quality monocular depth estimation via transfer learning, arXiv preprint arXiv:181211941 Alhashim, 2018, High quality monocular depth estimation via transfer learning, CoRR, abs/1812.11941 Mildenhall, 2019, Local light field fusion: practical view synthesis with prescriptive sampling guidelines, ACM Transactions on Graphics (TOG), 38, 1, 10.1145/3306346.3322980 Mildenhall, 2020, Nerf: representing scenes as neural radiance fields for view synthesis, arXiv preprint arXiv:200308934 Software for view synthesis. Software for view synthesis. http://www.fujii.nuee.nagoya-u.ac.jp/multiview-data/mpeg2/VS.htm; 2020. Loghman, 2015, Segmentation-based view synthesis for multi-view video plus depth, Multimed Tools Appl, 74, 1611, 10.1007/s11042-013-1747-7 He, 2012, Guided image filtering, IEEE Trans Pattern Anal Mach Intell, 35, 1397, 10.1109/TPAMI.2012.213 Yuan, 2021, Presim: a 3d photo-realistic environment simulator for visual AI, IEEE Robotics Autom Lett, 6, 2501, 10.1109/LRA.2021.3061994