Human Motion Capture: New Innovations in the Field of Computer Vision

Authors: Najm Alotaibi

Abstract:

Human motion capture has become one of the major area of interest in the field of computer vision. Some of the major application areas that have been rapidly evolving include the advanced human interfaces, virtual reality and security/surveillance systems. This study provides a brief overview of the techniques and applications used for the markerless human motion capture, which deals with analyzing the human motion in the form of mathematical formulations. The major contribution of this research is that it classifies the computer vision based techniques of human motion capture based on the taxonomy, and then breaks its down into four systematically different categories of tracking, initialization, pose estimation and recognition. The detailed descriptions and the relationships descriptions are given for the techniques of tracking and pose estimation. The subcategories of each process are further described. Various hypotheses have been used by the researchers in this domain are surveyed and the evolution of these techniques have been explained. It has been concluded in the survey that most researchers have focused on using the mathematical body models for the markerless motion capture.

Keywords: Human Motion Capture, Computer Vision, Vision based, Tracking.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1099618

References:

[1] Gall, J., Rosenhahn, B., Brox, T., & Seidel, H. P. (2010). Optimization and filtering for human motion capture. International journal of computer vision, 87(1-2), 75-92
[2] Pons-Moll, G., Baak, A., Helten, T., Muller, M., Seidel, H. P., & Rosenhahn, B. (2010). Multisensor-fusion for 3d full-body human motion capture. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on (pp. 663-670). IEEE.
[3] Swaisaenyakorn, S., Kelly, S. W., Young, P. R., & Batchelor, J. C. (2012). Evaluation of 3D animated human model from 3D scanner and motion capture to be used in electromagnetic simulator for body-centric system. In Biomedical Engineering and Informatics (BMEI), 5th International Conference on (pp. 632-636). IEEE.
[4] Field, M., Pan, Z., Stirling, D., & Naghdy, F. (2011). Human motion capture sensors and analysis in robotics. Industrial Robot: An International Journal, 38(2), 163-171.
[5] Sigal, L., Balan, A. O., & Black, M. J. (2010). Humaneva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. International journal of computer vision, 87(1-2), 4-27.
[6] Keskin, C., Kıraç, F., Kara, Y. E., & Akarun, L. (2013). Real time hand pose estimation using depth sensors. In Consumer Depth Cameras for Computer Vision (pp. 119-137). Springer London.
[7] G. Johnasson, (1973). “Visual Perception of Biological Motion and a Model for Its Analysis.” Perception Psychophysics 14(2): 201-211.
[8] M. K. Leung and Y.H. Yang (1995). “First Sight: A Human Body Outline Labeling System.” IEEE Transactions on Pattern Analysis and Machine Intelligence 17(4): 359-377.
[9] Sapp, Benjamin, David Weiss, and Ben Taskar. "Parsing human motion with stretchable models." Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, 2011.
[10] Shao, L., Ji, L., Liu, Y., & Zhang, J. (2012). Human action segmentation and recognition via motion and shape analysis. Pattern Recognition Letters, 33(4), 438-445.
[11] J. J. a. T. S. H. “. Kuch, “Vision Based Hand Modeling and Tracking for virtual teleconferencing and telecollaboration,” in ICCV , 1995.
[12] J. W. a. A. B. Davis, “The Representation and Recognition of Action Using Temporal Templates,” in International Conference on Computer Vision and, 1995.
[13] Jiang, Z., Lin, Z., & Davis, L. S. (2012). Recognizing human actions by learning and matching shape-motion prototype trees. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 34(3), 533-547.
[14] Niebles, J. C., Han, B., & Fei-Fei, L. (2010, June). Efficient extraction of human motion volumes by tracking. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on (pp. 655-662). IEEE.
[15] Li, R., Tian, T. P., Sclaroff, S., & Yang, M. H. (2010). 3d human motion tracking with a coordinated mixture of factor analyzers. International Journal of Computer Vision, 87(1-2), 170-190.
[16] Vondrak, M., Sigal, L., & Jenkins, O. C. (2013). Dynamical simulation priors for human motion tracking. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(1), 52-65.
[17] Stone, E. E., & Skubic, M. (2011, May). Evaluation of an inexpensive depth camera for passive in-home fall risk assessment. In Pervasive Computing Technologies for Healthcare (PervasiveHealth), 2011 5th International Conference on (pp. 71-77). IEEE.
[18] Aggarwal, J. K., & Ryoo, M. S. (2011). Human activity analysis: A review. ACM Computing Surveys (CSUR), 43(3), 16.
[19] Raskin, L., Rudzsky, M., & Rivlin, E. (2011). Dimensionality reduction using a Gaussian Process Annealed Particle Filter for tracking and classification of articulated body motions. Computer Vision and Image Understanding, 115(4), 503-519.