A Fast Depth-Map Generation Algorithm based on Motion Search from 2D Video Contents
- 1 Communication and information Security Lab, Shenzhen Graduate School, Peking University, China
- 2 Communication and information Security Lab, Shenzhen Graduate School, Peking University, China
Abstract
Generation of a depth-map from 2D video is the kernel of DIBR （Depth Image Based Rendering） in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map . Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.
- M. Op de Beeck, and A. Redert, “Three Dimensional video for the Home,” Proceedings of International Con-ference on Augmented, Virtual Environments and Three-Dimensional Image, May-June 2001, pp. 188-191.
- Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. SPIE, vol.5291, no.2, pp. 93-104 2004.
- P. Harman, J. Flack, S. Fox, M. Dowley.: Rapid 2D to 3D Conversion. Proceedings of SPIE, vol. 4660, pp. 78-86, 2002
- Wa James Tam, Carlos Vázquez, Filippo Speranza.: Three-dimensional TV: A novel method for generating surrogate depth maps using color information. Proc. SPIE Electronics Imaging-stereoscopic Displays and Applications XX, 2009.
- D. Kim, D. Min, K. Sohn.: Stereoscopic video generation method using mo-tion analysis. in Proceedings of the 3DTV Conference, pp. 1–4, Kos Island, May 2007.
- Sung-Fang Tsai, Chao-Chung Cheng, Chung-Te Li, Liang-Gee Chen.：A Real-Time 1080p 2D-to-3D Video Conversion System. IEEE Transactions on Consumer Electronics, Vol. 57, No. 2, pp. 803–804, May 2011.
- I. Ideses, L. P. Ya-roslavsky, B. Fishbain.: Real-time 2D to 3D video con-version. Journal of Real-Time Image Processing, vol. 2, no.1, pp. 3–9, 2007.
- C. Tomasi, R. Manduchi.: Bilateral Filtering for Gray and Color Images. Proceedings of the IEEE International Conference on Computer Vision, Bombay, India, pp.839-846, Bombay January 1998.
- M. T. Pourazad, P. Nasiopoulos, and R. K. Ward.: An H.264-based scheme for 2D to 3D video conversion. IEEE Transactions on Consumer Electronics, vol.55, no.2, pp. 742–748, 2009.
- A.-M. Huang, T. Nguyen.: Motion vector processing using the color information. IEEE International Conference on Image Processing, ICIP, pp. 1605-1608, Cairo, 2009.
- W. J. Tam, f. Speranza, L. Zhang, R. Renaud, J. Chan, C. Vazquez.: Depth Image Based Rendering for Multiview Stereoscopic Displays: Role of Information at Object Boundaries. Three-Dimensional TV, Video, and Display IV, vol. 6016, pp. 75-85, 2005.
- L. Po, X. Xu, Y. Zhu, S. Zhang: Automatic 2D-to-3D video conversion technique based on depth-from-motion and color segmentation. IEEE International Conference on Signal Processing, ICSP, pp.1000-1003, 2010.
- J. Chen, Yuesheng Zhu and X. Liu.: A New Block-Matching Based Approach for Automatic 2D to 3D Conversion. The 4th International Conference on Computer Engineering and Technology, ICCET, pp. 109-113，Thailand,2012.