View-Point Insensitive Human Pose Recognition using Neural Network and CUDA

Authors: Sanghyeok Oh, Keechul Jung

Abstract:

Although lots of research work has been done for human pose recognition, the view-point of cameras is still critical problem of overall recognition system. In this paper, view-point insensitive human pose recognition is proposed. The aims of the proposed system are view-point insensitivity and real-time processing. Recognition system consists of feature extraction module, neural network and real-time feed forward calculation. First, histogram-based method is used to extract feature from silhouette image and it is suitable for represent the shape of human pose. To reduce the dimension of feature vector, Principle Component Analysis(PCA) is used. Second, real-time processing is implemented by using Compute Unified Device Architecture(CUDA) and this architecture improves the speed of feed-forward calculation of neural network. We demonstrate the effectiveness of our approach with experiments on real environment.

Keywords: computer vision, neural network, pose recognition, view-point insensitive, PCA, CUDA.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1060884

References:

[1] Y. Sagawa, M. Shimosaka, T. Mori and T. Sato, "Fast Online Human Pose Estimation via 3D Voxel Data", Intelligent Robots and Systems, pp. 1034-1040, 2007.
[2] Catherine A., Xingtai Q., Arash M., Maurice., "A novel approach for recognition of human actions with semi-global features", Machine Vision and Applications, 2008, pp. 27-34, 2008.
[3] M. Voit, K. Nickel, R. Stiefelhagen, "Neural Network-Based Head Pose Estimation and Multi-view Fusion", LNCS 4122, pp. 291-298, 2007.
[4] C. Yuan, H. Niemann, "Neural networks for the recognition and pose estimation of 3D objects from a single 2D perspective view", Image and Vision Computing 19, pp. 585-592, 2001.
[5] A. Agarwal, B. Triggs, "Human Pose from Silhouettes by Relevance Vector Regression", CVPR, vol2., pp882-888, 2004.
[6] R. Rosales, S. Sclaroff, "Learning and synthesizing human body motion and posture", IEEE, 2000.
[7] F. Lb, R. Nevatia, "Single View Human Action Recognition using Key Pose Matching and Viterbi Path Searching", CVPR, 2007.
[8] H. Yu, G. Sun, W. Song, X. Li, "Human Motion Recognition Based on Neural Network", IEEE, Vol. 2, pp. 982, 2005.
[9] M. Voit, K. Nicket, R. Stiefelhagen, "Multi-view Head Pose Estimation using Neural Networks", Computer and Robot Vision, pp. 347-352, 2005.
[10] B. Oh, "Face recognition by using neural network classifiers based on PCA and LDA" IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 1699-1703, Oct. 2005.
[11] A. Park, K. Jung, "Neural Networks Implementation using CUDA and OpenMP", DICTA 2008 (Digital Image Computing: Techniques and Applications) December 1st, 2008, pp. 155-161.
[12] Van den Bergh, M. Koller-Meier, E. Van Gool, "Fast body posture estimation using volumetric features". In IEEE visual motion computing, 2008
[13] B. Peng, G. Qian, Y. Ma, "View-Invariant Pose Recognition Using Multilinear Analysis and the Universum", ISVC 2008, Part II, LNCS 5359, pp.581-591, 2008.
[14] M. Kortgen, G.-J. Park, M. Novotni, and R. Klein, "3D Shape Matching with 3D Shape Contexts," in Proc. WSCG, 2003