Augmented Reality Interaction System in 3D Environment

Authors: Sunhyoung Lee, Askar Akshabayev, Beisenbek Baisakov, Youngjoon Han, Hernsoo Hahn

Abstract:

It is important to give input information without other device in AR system. One solution is using hand for augmented reality application. Many researchers have proposed different solutions for hand interface in augmented reality. Analyze Histogram and connecting factor is can be example for that. Various Direction searching is one of robust way to recognition hand but it takes too much calculating time. And background should be distinguished with skin color. This paper proposes a hand tracking method to control the 3D object in augmented reality using depth device and skin color. Also in this work discussed relationship between several markers, which is based on relationship between camera and marker. One marker used for displaying virtual object and three markers for detecting hand gesture and manipulating the virtual object.

Keywords: Augmented Reality, depth map, hand recognition, kinect, marker, YCbCr color model.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1073461

References:

[1] ARTOOLKIT. (2003). Human Interface Technology Laboratory. Retrieved 10 2011, from http://www.hitl.washington.edu/artoollcit/
[2] M.Billinghurst, H. K. (1999 ). Augmented Reality, 1999. (IWAR '99) Proceedings. 2nd IEEE and ACM International Workshop. Marker tracking and HMD calibration for a video-based augmented reality conferencing system (pp. 85 - 94). San Francisco, CA , USA : ACM .
[3] OpenNT. (n.d.). OpenNI documentation. Retrieved 09 2011, from http://www.openni.org/images/stories/pdf/OpenNI_UserGuide_v4.pdf
[4] Rovelo, G. (n.d.). ARTOOLKIT II. Retrieved 2011, from https://j ira. ai2 .upv. es/confluence/download/attachments/12222496/W GM18_ARToolKitII.pdf?version=l&modificationDate=13040952630 00
[5] S. Matyunin, D. Vatolin, Y. B erdnikov, M. Smirnov. 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV). Temporal filtering for depth maps generated by Kinect depth came.
[6] V. Buchman, S. Violich and M. Billinghurst and A. Cockburn. (2004). 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia. FingARtips — Gesture Based Direct Manipulation in Augmented Reality.
[7] Zhang, Z. (1999). Flexible camera calibration by viewing a plane from unknown orientations. One MicrosoftWay, Redmond,WA 98052-6399, USA : Microsoft Research.