Gradual Shot Boundary Detection and Classification Based on Fractal Analysis

Authors: Zeinab Zeinalpour-Tabrizi, Faeze Asdaghi, Mahmooh Fathy, Mohammad Reza Jahed-Motlagh

Abstract:

Shot boundary detection is a fundamental step for the organization of large video data. In this paper, we propose a new method for video gradual shots detection and classification, using advantages of fractal analysis and AIS-based classifier. Proposed features are “vertical intercept" and “fractal dimension" of each frame of videos which are computed using Fourier transform coefficients. We also used a classifier based on Clonal Selection Algorithm. We have carried out our solution and assessed it according to the TRECVID2006 benchmark dataset.

Keywords: shot boundary detection, gradual shots, fractal analysis, artificial immune system, choose Clooney.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1082417

References:

[1] S. W. Smoliar and H.-J. Zhang, "Content-based video indexing and retrieval," IEEE Multimedia, vol. 1, no. 2, 1994, pp. 62-72.
[2] R. Lienhart, S. Pfeiffer, and W. Effelsberg, "Video abstracting," Commun. ACM, vol. 40, no. 12, 1997, pp. 55-62.
[3] X. U. Cabedo and S. K. Bhattacharjee, "Shot detection tools in digital video," in Proc. Non-Linear Model based Image Analysis, 1998, pp.121-126.
[4] V. Kobla, D. DeMenthon, and D. Doermann, "Special effect edit detection using videotrails: a comparison with existing techniques," in Proc. SPIE Conf. Storage Retrieval Image Video Databases VII, Jan. 1999, pp. 302-313.
[5] A. Nagasaka and Y. Tanaka, "Automatic Video Indexing and Full-Video Search for Object Appearances," Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II, North- Holland Publishing Co., 1992, pp. 113-127.
[6] H. Zhang, A. Kankanhalli, and S.W. Smoliar, "Automatic partitioning of full-motion video," Multimedia Systems, vol. 1, Jan. 1993, pp. 10-28.
[7] B. Shahraray, "Scene change detection and content-based sampling of video sequences," Apr. 1995.
[8] A. Nagasaka and Y. Tanaka, "Automatic Video Indexing and Full-Video Search for Object Appearances," Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II, North- Holland Publishing Co., 1992, pp. 113-127.
[9] W. Xiong, J. C.-M. Lee, "Efficient Scene Change Detection and Camera Motion Annotation for Video Classification", Computer Vision and Image Understanding, Vol.71, Issue 2,1998, pp.166-181.
[10] A.M. Ferman and A.M. Tekalp, "Efficient Filtering and Clustering Methods for Temporal Video Segmentation and Visual Summarization," Journal of Visual Communication and Image Representation, vol. 9, Dec. 1998, pp. 336-351.
[11] F. Arman, A. Hsu, and M. Chiu, "Image processing on compressed data for large video databases," Proceedings of the first ACM international conference on Multimedia, Anaheim, California, United States: ACM, 1993, pp. 267-272.
[12] B. Yeo and B. Liu, "Rapid scene analysis on compressed video," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 5, 1995, pp. 544, 533.
[13] K. Shen and E.J. Delp, "A fast algorithm for video parsing using MPEG compressed sequences," Proceedings of the 1995 International Conference on Image Processing (Vol.2)-Volume 2 - Volume 2, IEEE Computer Society, 1995, p. 2252.
[14] Z. Cernekova, I. Pitas, and C. Nikou, "Information theory-based shot cut/fade detection and video summarization," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 16, 2006, pp. 82-91.
[15] P. Chiu, A. Girgensohn, W. Polak, E. Rieffel, and L. Wilcox, "A genetic algorithm for video segmentation and summarization," Multimedia and Expo, 2000. ICME 2000. 2000 IEEE International Conference on, 2000, pp. 1329-1332 vol.3.
[16] . Lienhart, "Reliable transition detection in videos: a survey and practitioner-s guide," Int. J. Image Graph., vol. 1, no. 3, 2001, pp. 469- 486.
[17] M. Albanese, A. Chianese, V. Moscato, and L. Sansone, "A Formal Model for Video Shot Segmentation and its Application via Animate Vision," Multimedia Tools and Applications, vol. 24, Dec. 2004, pp. 253-272.
[18] Jinhui Yuan, Huiyi Wang, Lan Xiao, Wujie Zheng, Jianmin Li, Fuzong Lin, and Bo Zhang, "A Formal Study of Shot Boundary Detection," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 17, 2007, pp. 168-186.
[19] Sarkar N., B.B. Chaudhuri, "An efficient differential box-counting approach to compute fractal dimension of image", IEEE Transaction on System Man and Cybernet, vol.24, no.1, 1994, pp.115-120.
[20] Zhang J. , Regtien P.P.L. , Korsten M.J. , "Monitoring of dry sliding wear using fractal analysis", 10th TC-10 IMEKO Conference on Technical Diagnostics, 9-10 June, 2005, Budapest, Hungary
[21] Russ J. C.: Fractal Surfaces. New York (etc.), Plenum Press 1994.
[22] Rawers J., Tylczak J.: Fractal characterization of wear-erosion surfaces, Journal of Materials Engineering and Performance, vol. 8, no.6, 1999, pp. 669-676.
[23] R.C. Gonzalez and R.E. Woods, Digital Image Processing, Prentice Hall, 2002.
[24] Z. Cernekov'a, N. Nikolaidis, I. Pitas. AIIA shot boundary detection at TRECVID 2006, TREC Video Retrieval Evaluation(C), 2006
[25] NIST, Homepage of Trecvid Evaluation, http://wwwnlpir. nist.gov/projects/trecvid/