Key-frame-based depth propagation for semi-automatic stereoscopic video conversion

Guo-Shiang Lin1, Jian-Fa Huang2, Wen-Nung Lie2
1Dept. of Computer Science and Information Engineering, Da-Yeh University, Taiwan, ROC
2Dept. of Electrical Engineering, National Chung Cheng University, Taiwan, ROC

Tài liệu tham khảo

Cheng, 2011, Spatio-temporally consistent novel view synthesis algorithm from video-plus depth sequences for autostereoscopic displays, IEEE Trans. Broadcast., 57, 523, 10.1109/TBC.2011.2139090 Y.H. Chiu, M.S. Lee, W.K. Liao, Voting based depth map refinement and propagation for 2D to 3D conversion, in: Proc. 2012 Asia-Pacific Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC), 2012, pp. 1–8. Lin, 2012, A stereoscopic video conversion scheme based on spatio-temporal analysis of MPEG videos, EURASIP J. Adv. Signal Process., 2012, 1, 10.1186/1687-6180-2012-237 Y.L. Chang, W.Y. Chen, J.Y. Chang, Y.M. Tsai, C.L. Lee, L.G. Chen, Priority depth fusion for the 2D-to-3D conversion system, in: Proc. SPIE-IS&T Electronic Imaging, 2008, pp. 680513.1–680513.8. C.C. Cheng, C.T. Li, P.S. Huang, T.K. Lin, Y.M. Tsai, L.G. Chen, A block-based 2D-to-3D conversion system with bilateral filter, in: Proc. IEEE Int’l Conf. on Consumer Electronics, 2009, pp. 1–2. Z. Zhang, C. Zhou, B. Xin, Y. Wang, W. Gao, An interactive system of stereoscopic video conversion, in: Proc. ACM MM’12, 2012, pp. 149–158. C. Wu, Er Guihua, X. Xie, Tao Li, X. Cao, Q. Dai, A novel method for semi-automatic 2D to 3D video conversion, in: Proc. 3DTV Conference: The True Vision – Capture, Transmission and Display of 3D Video, 2008, pp. 65–68. C. Varekamp, B. Barenbrug, Improved depth propagation for 2D to 3D Video conversion using key-frames, in: Proc. 4th IET Conf. on Visual Media Production, 2007, pp. 1–7. Cao, 2011, Semi-automatic 2D-to-3D conversion using disparity propagation, IEEE Trans. Broadcast., 57, 491, 10.1109/TBC.2011.2127650 Lie, 2011, 2D to 3D video conversion with key-frame depth propagation and trilateral filtering, IET Electron. Lett., 47, 319, 10.1049/el.2010.2912 Ideses, 2007, Real-time 2D to 3D video conversion, J. Real-Time Image Proc., 2, 3, 10.1007/s11554-007-0038-9 Methodology for the subjective assessment of the Quality of Television Pictures, Int. Telecomm. Union/ITU Radio Communication Sector, ITU-R BT.500-11, Jan. 2002. Li, 2004, Lazy snapping, ACM Trans. Graph. (TOG), 23, 303, 10.1145/1015706.1015719 Zhang, 2011, 3D-TV content creation: automatic 2D-to-3D video conversion, IEEE Trans. Broadcast., 57, 372, 10.1109/TBC.2011.2122930 Daribo, 2009, Motion vector sharing and bitrate allocation for 3D video-plus-depth coding, EURASIP J. Adv. Signal Process., 2009, 1 P. Harman, J. Flack, S. Fox, M. Dowley, Rapid 2D to 3D conversion, in: Proc. SPIE, 2002, pp. 78–86. M. Guttmann, L. Wolf, D. Cohen-Or, Semi-automatic stereo extraction from video footage, in: Proc. IEEE Int’l Conf. on Computer Vision, 2009, pp. 136–142. C.T.E.R. Hewage, S. Worrall, S. Dogan, A.M. Kondoz, Frame concealment algorithm for stereoscopic video using motion vector sharing, in: Proc. IEEE Conference Multimedia Expo, 2008, pp. 485–488. D. Wang, J. Liu, J. Sun, W. Liu, Y. Li, A novel key-frame extraction method for semi-automatic 2D-to-3D video conversion, in: Proc. Int’l Symp. on Broadband Multimedia Systems and Broadcasting (BMSB), 2012, pp. 1–5. G.S. Lin, C.Y. Chen, C.T. Kuo, W.N. Lie, K.C. Liu, Adaptive support-window approximation to bilateral filtering, in: Proc. The 21st International Conference on Pattern Recognition, 2012, pp. 2013–2016. Lin, 2009, A feature-based Scheme for detecting and classifying video-shot transitions based on spatio-temporal analysis and fuzzy classification, Int. J. Pattern Recognit Artif Intell., 23, 1179, 10.1142/S0218001409007521 P. Cuenca, L. Orozco-Barbosa, A. Garrido, F. Quiles, T. Olivares, A survey of error concealment schemes for MPEG-2 video communications over ATM networks, in: Proc. IEEE 1997 Canadian Conference on Electrical and Computer Engineering, 1997, pp. 118–121. Wang, 2002 Pinson, 2004, A new standardized method for objectively measuring video quality, IEEE Trans. Broadcast., 50, 312, 10.1109/TBC.2004.834028 Vetro, 2011, 3D-TV content storage and transmission, IEEE Trans. Broadcast., 57, 384, 10.1109/TBC.2010.2102950 D. Wang, J. Liu, Y. Ren, C. Ge, W. Liu, Y. Li, Depth propagation based on depth consistency, in: Proc. Int’l Conf. on Wireless Communications & Signal Processing (WCSP), 2012, pp. 1–6. W. Huang, X. Cao, K. Lu, Q. Dai, A. Bovik, Towards naturalistic depth propagation, in: Proc. 2013 IEEE 11th Image, Video, and Multidimensional Signal Processing (IVMSP) Workshop, 2013, pp. 1–4. C. Jung, J. Cai, Superpixel matching-based depth propagation for 2D-to-3D conversion with joint bilateral filtering, in: Proc. IEEE Int’l Conf. on Image Processing (ICIP), 2015, pp. 3515–3519. H. Wang, Y. Tian, Y. Zhang, A novel depth propagation algorithm with color guided motion estimation, in: Proc. IEEE Conf. on Visual Communications and Image Processing (VCIP), 2013, pp. 1–5. Wang, 2014, Example-based video stereolization with foreground segmentation and depth propagation, IEEE Trans. Multimedia, 16, 1905, 10.1109/TMM.2014.2341599 Lie, 2015, Error concealment for the transmission of H.264/AVC-compressed 3D video in color plus depth format, J. Vis. Commun. Image Represent., 32, 237, 10.1016/j.jvcir.2015.08.012 G.S. Lin, J.F. Huang, W.N. Lie, Semi-automatic 2D-to-3D video Conversion based on depth Propagation from key-frames, in: Proc. IEEE Int’l Conf. on Image Processing (ICIP-2013), 2013, pp. 2202–2206.