3D Star Skeleton for Fast Human Posture Representation

Authors: Sungkuk Chun, Kwangjin Hong, Keechul Jung

Abstract:

In this paper, we propose an improved 3D star skeleton technique, which is a suitable skeletonization for human posture representation and reflects the 3D information of human posture. Moreover, the proposed technique is simple and then can be performed in real-time. The existing skeleton construction techniques, such as distance transformation, Voronoi diagram, and thinning, focus on the precision of skeleton information. Therefore, those techniques are not applicable to real-time posture recognition since they are computationally expensive and highly susceptible to noise of boundary. Although a 2D star skeleton was proposed to complement these problems, it also has some limitations to describe the 3D information of the posture. To represent human posture effectively, the constructed skeleton should consider the 3D information of posture. The proposed 3D star skeleton contains 3D data of human, and focuses on human action and posture recognition. Our 3D star skeleton uses the 8 projection maps which have 2D silhouette information and depth data of human surface. And the extremal points can be extracted as the features of 3D star skeleton, without searching whole boundary of object. Therefore, on execution time, our 3D star skeleton is faster than the “greedy" 3D star skeleton using the whole boundary points on the surface. Moreover, our method can offer more accurate skeleton of posture than the existing star skeleton since the 3D data for the object is concerned. Additionally, we make a codebook, a collection of representative 3D star skeletons about 7 postures, to recognize what posture of constructed skeleton is.

Keywords: computer vision, gesture recognition, skeletonization, human posture representation.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1332290

References:

[1] Nicu D. Cornea, Deborah Silver, Patrick Min, "Curve-Skeleton Properties, Application, and Algorithms," IEEE Trans. Visualization and Computer Graphics, vol. 13, 2007, pp. 530-548.
[2] Gunilla Borgefors, "Distance transformations in digital images," Computer Vision, Graphics, and Image Processing, vol. 34, 1986, pp. 344-371.
[3] Gunilla Borgefors, "Distance transformation in arbitrary dimensions," Computer Vision, Graphics, and Image Processing, vol. 27, 1984, pp. 321-345.
[4] Gunilla Borgefors, "On digital distance transforms in three dimensions," Computer Vision and Image Understanding, vol. 64, 1996, pp. 368-376.
[5] Frank Y.Shih and Christopher C.Pu, "A skeletonization algorithm by maxima tracking on Euclidean distance transform", J. Pattern Recognition, vol. 28, 1995, pp. 331-341.
[6] Franz Aurenhammer, "Voronoi diagrams - A Survey of a fundamental geometric data structure," ACM Conputing Surveys, vol. 23, 1991, pp. 345-405.
[7] Jonathan W. Brandt and V. Ralph Algazi, "Continuous skeleton computation by Voronoi diagram," CVGIP : Image Understanding, vol. 55, 1991, pp. 329-338.
[8] Kenneth E. Hoff III, Tim Culver, John Keyser, Ming Lin and Dinesh Manocha "Fast computation of generalized Voronoi diagrams using graphic hardware," in Proc. 26th annual Conf. Computer graphics and interactive technique, 1999, pp. 277-286.
[9] Kalman Palagyi, Erich Sorantin, Emese Balogh, Attila Kuba, Csongor Halmai1, Balazs Erdohelyi, and Klaus Hausegger, "A Sequential 3D Thinning Algorithm and Its Medical Applications," in Proc. 17th international Conf. IPMI, vol. 2082, 2001, pp. 409-415.
[10] Kalman Palagyi and Attila Kuba, "A 3D 6-subiteration thinning algorithm for extracting medial lines," Pattern Recognition Letters, vol. 19, 1998, pp. 613-627.
[11] Kalman Palagyi and Attila Kuba, "Directional 3D thinning using 8 subiterations," in Proc. 8th international Conf. DGCI, vol. 1568, 1999, pp. 325-336.
[12] Ta-Chih Lee, Rangasami L. Kashyap and Chong-Nam Chu, "Building skeleton models via 3-D medial surface/axis thinning algorithms," CVGIP : Graphical Models and Image Processing, vol. 56, 1994, pp. 462-478.
[13] H. Fujiyoshi and A. J. Lipton, "Real-time human motion analysis by image skeletonization," 4th IEEE Workshop on Application of Computer Vision, 1998, pp. 15-21.
[14] Hsuan-Sheng Chen, Hua-Tsung Chen, Yi-Wen Chen and Suh-Yin Lee, "Human Action Recognition Using Star Skeleton," in Proc. 4th ACM international workshop on Video surveillance and sensor networks, 2006, pp. 171-178.