Video Shot Boundary Detection Using Normalized Periodogram Distance Metric
- 1 Electronics and Communication Engineering, Thiagarajar College of Engineering, Madurai, India
- 2 Electronics and Communication Engineering, Thiagarajar College of Engineering, Madurai, India
Abstract
Video shot boundary detection is the primary task for content based video management and retrieval system. This paper proposes a shot boundary detection strategy by exploiting the pros of Normalized Periodogram for efficiently representing the content of the video. A Normalized Periodogram based distance metric to detect the key frames using shot boundary, namely Distance- Left-Right (D LR ), is addressed, which is computed on a sliding sub-window basis. The D LR sequence is used to detect the suspected shot boundary frames and a transition type detection procedure is adapted to these suspected frames for discriminating the abrupt and gradual transitions. The proposed shot boundary detection methodology yields Precision—95.02%, Recall—93.15% and F1 score—94.07% for cut, Precision—86.57%, Recall—86.67% and F1 score—86.61% for gradual, Precision—90.6%, Recall—90.02% and F1 score—90.3% for overall transitions. Experimental results show that the proposed approach is superior to the recently available shot boundary detection techniques because of its robustness and simplicity, and presents an effective distance metric to detect the shot boundary.
- Yuan, J.H., Wang, H.Y., Xiao, W., Zheng, J., Li, J.M., Lin, F.Z. and Zhang, B. (2007) A Formal Study of Shot Boundary Detection. IEEE Transactions on Circuits and Systems for Video Technology, 17, 168-186. http://dx.doi.org/10.1109/TCSVT.2006.888023
- Nagasaka, A., Tanaka, Y., Knuth, E. and Wegner, L. (1992) Automatic Video Indexing and Full Video Search for Object Appearances. In: Knuth, E. and Wegner, L., Eds., Visual Database Systems II, North Holland Publishing Co., Netherlands, 113-127.
- Zhang, C. and Wang, W. (2012) A Robust and Efficient Shot Boundary Detection Approach Based on Fisher Criterion. Proceedings of 20th ACM International Conference on Multimedia, Nara, 29 October-2 November 2012, 701-704.
- Patel, N.V. and Sethi, I.K. (1997) Video Shot Detection and Characterization for Video Databases. Pattern Recognition, 30, 583-592. http://dx.doi.org/10.1016/S0031-3203(96)00114-8
- Tan, Y.P., Nagamani, J. and Lu, H. (2003) Modified Kolmogorov-Smirnov Metric for Shot Boundary Detection. Electronic Letters, 39, 1313-1315.
- Dailianas, A., Allen, R.B. and England, P. (1996) Comparison of Automatic Video Segmentation Algorithms. Proceedings of SPIE, 2615, 2-16. http://dx.doi.org/10.1117/12.229193
- Cernekova, Z., Pitas, I. and Nikou, C. (2006) Information Theory-Based Shot Cut/Fade Detection and Video Summarization. IEEE Transactions on Circuits and Systems for Video Technology, 16, 82-91. http://dx.doi.org/10.1109/TCSVT.2005.856896
- Petersohn, C. (2004) Dissolve Shot Boundary Determination. In Proceedings of European Workshop for the Integration of Knowledge, Semantics and Digital Media Technology, London, 25-26 November 2004, 87-94.
- Yoo, H.W., Ryoo, H.J. and Jang, D.S. (2006) Gradual Shot Boundary Detection Using Localized Edge Blocks. Multimedia Tools Appl., 28, 283-300. http://dx.doi.org/10.1007/s11042-006-7715-8
- Shahraray, B. (1995) Scene Change Detection and Content-Based Sampling of Video Sequences. Proceedings of SPIE, 2419, 2-13. http://dx.doi.org/10.1117/12.206348
- Kawai, Y., Sumiyoshi, V. and Yagi, N. (2007) Shot Boundary Detection at TRECVID 2007. Proceedings of TREC Video Retrieval Evaluation Online, TRECVID 2007 Workshop, Gaithersburg, 16 January 2007.
- Xue, L., Li, C., Li, H. and Xiong, Z. (2008) A General Method for Shot Boundary Detection. International Conference on Multimedia and Ubiquitous Engineering, Busan, 24-26 April 2008, 394-397.