3DARModeler: a 3D Modeling System in Augmented Reality Environment

Authors: Trien V. Do, Jong-Weon Lee

Abstract:

This paper describes a 3D modeling system in Augmented Reality environment, named 3DARModeler. It can be considered a simple version of 3D Studio Max with necessary functions for a modeling system such as creating objects, applying texture, adding animation, estimating real light sources and casting shadows. The 3DARModeler introduces convenient, and effective human-computer interaction to build 3D models by combining both the traditional input method (mouse/keyboard) and the tangible input method (markers). It has the ability to align a new virtual object with the existing parts of a model. The 3DARModeler targets nontechnical users. As such, they do not need much knowledge of computer graphics and modeling techniques. All they have to do is select basic objects, customize their attributes, and put them together to build a 3D model in a simple and intuitive way as if they were doing in the real world. Using the hierarchical modeling technique, the users are able to group several basic objects to manage them as a unified, complex object. The system can also connect with other 3D systems by importing and exporting VRML/3Ds Max files. A module of speech recognition is included in the system to provide flexible user interfaces.

Keywords: 3D Modeling, Augmented Reality, GeometricModeling, Virtual Reality

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1082871

References:

[1] http://www.hitl.washington.edu/artoolkit/
[2] R. Azuma, "A survey of augmented reality", In Presence: Teleoperators and Virtual Environments 6, 4 (August 1997), 355 - 385.
[3] http://www.ims.tuwien.ac.at/research/construct3d/
[4] Hannes Kaufmann, "Construct3D: An Augmented Reality Application for Mathematics and Geometry Education", ACM Multimedia Conference 2002, DOI= http://doi.acm.org/10.1145/641140
[5] Gun A. Lee, Claudia Nelles, Mark Billinghurst, Gerard Jounghyun Kim, "Immersive Authoring of Tangible Augmented Reality Applications", Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2004)
[6] Peter Fiala, Nicoletta Adamo-Villani, "ARpm: an Augmented Reality Interface for Polygonal Modeling" ", Proceedings of the Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2005)
[7] Wayne Piekarski and Bruce H. Thomas , "Developing Interactive Augmented Reality Modelling Applications", International workshop on software technology for Augmented Reality
[8] Hirokazu Kato, Keihachiro Tachibana, Masaaki Tanabe, Takeaki Nakajima, Yumiko Fukuda, "A City-Planning System based on Augmented Reality with a Tangible Interface", Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2003)
[9] Michael O-Rourke, "Principles of Three-Dimensional Computer Animation: Modeling, Rendering, and Animating With 3d Computer Graphics", New York Norton Publisher, pp. 53-60.
[10] http://bishopw.loni.ucla.edu/AIR5/homogenous.html.
[11] Katrien Jacobs, Cameron Angus, Celine Loscos, Jean-Daniel Nahmias, Alex Reche, Anthony Steed, "Automatic generation of consistent shadows for Augmented Reality", Proceedings of Graphics Interface 2005
[12] Natsuki Sugano, Hirokazu Kato and Keihachiro Tachibana, "The Effects of Shadow Representation of Virtual Objects in Augmented Reality", Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2003)
[13] Masayuki Kanbara and Naokazu Yokoya, "Real-time Estimation of Light Source Environment for Photorealistic Augmented Reality", Proceedings of the 17th International Conference on Pattern Recognition (ICPR-04)
[14] http://www.tinmith.net
[15] http://www.hitlabnz.org/wiki/Black_Magic_Book