Multiplayer RC-Car Driving System in a Collaborative Augmented Reality Environment

Authors: Kikuo Asai, Yuji Sugimoto

Abstract:

We developed a prototype system for multiplayer RC-car driving in a collaborative augmented reality (AR) environment. The tele-existence environment is constructed by superimposing digital data onto images captured by a camera on an RC-car, enabling players to experience an augmented coexistence of the digital content and the real world. Marker-based tracking was used for estimating position and orientation of the camera. The plural RC-cars can be operated in a field where square markers are arranged. The video images captured by the camera are transmitted to a PC for visual tracking. The RC-cars are also tracked by using an infrared camera attached to the ceiling, so that the instability is reduced in the visual tracking. Multimedia data such as texts and graphics are visualized to be overlaid onto the video images in the geometrically correct manner. The prototype system allows a tele-existence sensation to be augmented in a collaborative AR environment.

Keywords: Multiplayer, RC-car, Collaborative Environment, Augmented Reality.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1090677

References:

[1] S. Feiner, "Augmented reality: a new way of seeing,” Scientific American, vol.286, pp. 34–41, 2002.
[2] C. P. Barlett, C. A. Anderson, and E. L. Swing, "Video game effects—confirmed, suspected, and speculative: a review of the evidence,” Simulation & Gaming, vol.40, pp.377–403, 2009.
[3] O. Oda, L. J. Lister, S. White, and S. Feiner, "Developing an augmented reality racing game,” in Proc. International Conference on Intelligent Technologies for Interactive Entertainment, 8 pages, 2008.
[4] AD-DISPATCH, Augmented Reality Remote Control Car, http://www.ad-dispatch.com/our-work/toys/
[5] Sweet Tech Studio, Augmented Reality Remote Control Car, http://www.sweet-tech-studio.com/2009/01/diy-augmented-reality-remote-control.html
[6] B. H. Thomas, "A survey of visual, mixed, and augmented reality gaming,” ACM Computers in Entertainment, vol.10, 33 pages, 2012.
[7] C. T. Tan, and D. Soh, "Augmented Reality Games: A Review,” in Proc. Asian Simulation and AI in Games Conference, GAMEON-ASIA, EUROSIS, pp.212–218, 2011.
[8] R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, B. MacIntyre, "Recent advances in augmented reality,” IEEE Computer Graphics and Applications, vol.21, pp.34–47, 2001.
[9] T. Ohshima, K. Satoh, H. Yamamoto, H. Tamura, "AR2 Hockey system: A collaborative mixed reality system,” Transactions of the Virtual Reality Society of Japan, vol.3, pp.55–60, 1998.
[10] T. Starner, B. Leibe, B. Singletary, J. Pair, "MIND-WARPING: towards creating a compelling collaborative augmented reality game,” in Proc. International Conference on Intelligent User Interfaces, pp.256–259, 2000.
[11] B. Thomas, B. Close, J. Donoghue, J. Squires, P. D. Bondi, M. Morris, W. Piekarski, "ARQuake: An outdoor/indoor augmented reality first person application,” in Proc. International Symposium on Wearable Computers, pp.139–146, 2000.
[12] A. D. Cheok, X. Yang, Z. Z. Ying, M. Billinghurst, H. Kato, "Touch-Space: mixed reality game space based on ubiquitous, tangible, and social computing,” Personal and Ubiquitous Computing, vol.6, pp.430–442, 2002.
[13] K. Phillips, and W. Piekarski, "Possession techniques for interaction in real-time strategy augmented reality games,” inProc. International Conference on Advances in Computer Entertainment Technology, 10 pages, 2005.
[14] A. Hill, J. Schiefer, J. Wilson, B. Davidson, M. Gandy, and B. MacIntyre, "Virtual transparency: Introducing parallax view into video see-through AR,” in Proc. International Symposium on Mixed and Augmented Reality (ISMAR), pp.239–240, 2011.
[15] D. Baricevic, C. Lee, M. Turk, T. Hollerer, and D. A. Bowman, "A hand-held AR magic lens with user-perspective rendering,” in Proc. International Symposium on Mixed and Augmented Reality (ISMAR), pp.197–206, 2012.
[16] D. Wagner, T. Pintaric, F. Ledermann, D. Schmalstieg, "Towards massively multi-user augmented reality on handheld devices,” in Proc. International Conference on Pervasive Computing, pp.208–219, 2005.
[17] A. Henrysson, M. Billinghurst, and M. Ollila, "AR tennis,” in ACM SIGGRAPH Emerging technologies, 1 page, 2006.
[18] O. Oda, and S. Feiner, "Interference avoidance in multi-user hand-held augmented reality,” in Proc. IEEE International Symposium on Mixed and Augmented Reality, pp.13–22, 2009.
[19] int13, AR Defender, http://www.ardefender.com/
[20] Sony Computer Entertainment Europe, Invizimals, http://www.invizimals.com/
[21] O. Bimber, and R. Rasker, Spatial augmented reality: merging real and virtual worlds, A K Peters, 2005.
[22] B. Piper, C. Ratti, and H. Ishii, "Illuminating clay: a 3-D tangible interface for landscape analysis,” in Proc. SIGCHI Conference on Human Factors in Computing Systems, pp. 355–362, 2002.
[23] B. Stevens, J. Jerrams-Smith, D. Heathcote, and D. Callear, "Putting the virtual into reality: assessing object-presence with projection-augmented models,” Presence: Teleoperators and Virtual Environments, vol.11, pp.79–92, 2002.
[24] R. Colvin, T. Hung, D. Jimison, B. Johnson, E. Myers, T. Blaine, "A dice game in third person augmented reality,” in Proc. International Augmented Reality Toolkit Workshop, pp.3–4, 2003.
[25] M. Kojima, M. Sugimoto, A. Nakamura, M. Tomiya, M. Inami, H. Nii, "Augmented Coliseum: an augmented game environment with small vehicles,” in Proc. IEEE International Workshop on Horizontal Interactive Human-Computer Systems, pp.3–8, 2006.
[26] E. Tse, S. Greenberg, C. Shen, and C. Forlines, "Multimodal multiplayer tabletop gaming,” ACM Computers in Entertainment, vol.5, 12 pages, 2007.
[27] J. Leitner, M. Haller, K. Yun, W. Woo, M. Sugimoto, and M. Inami, "IncreTable, a mixed reality tabletop game experience,” in Proc. International Conference on Advances in Computer Entertainment Technology, pp.9–16, 2008.
[28] M. Mine, D. Rose, B. Yang, J. van Baar, and A. Grundhöfer, "Projection-based augmented reality in Disney theme parks,” Computer, vol.45, pp.32–40, 2012.
[29] M. M. Wloka, and B. G. Anderson, "Resolving occlusion in augmented reality,” in Proc. ACM symposium on Interactive 3D graphics (I3D '95), pp.5–12, 1995.
[30] M. -O. Berger, "Resolving occlusion in augmented reality: a contour based approach without 3D reconstruction,” in Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp.91–96, 1997.
[31] J. Schmidt, H. Niemann, and S. Vogt, "Dense disparity maps in real-time with an application to augmented reality,” in Proc. IEEE Workshop on Applications of Computer Vision (WACV 2002), pp.225–230, 2002.
[32] K. C. Ong, H. C. Teh, and T. S. Tan, "Resolving occlusion in image sequence made easy,” The Visual Computer, vol.14, pp.153–165, 1998.
[33] V. Lepetit, M. -O. Berger, "A semi-automatic method for resolving occlusion in augmented reality,” in Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol.2, pp.225–230, 2000.
[34] HIT Lab, University of Washington: AR Tool kit. http://www.hitl.washington.edu/artoolkit/