A Simulation Tool for Projection Mapping Based on Mapbox and Unity

Authors: Noriko Hanakawa, Masaki Obana

Abstract:

A simulation tool is proposed for big-scale projection mapping events. The tool has four main functions based on Mapbox and Unity utilities. The first function is building three-dimensional models of real cities using Mapbox. The second function is movie projections to some buildings in real cities using Unity. The third is a movie sending function from a PC to a virtual projector. The fourth function is mapping movies with fitting buildings. The simulation tool was adapted to a real projection mapping event held in 2019. The event completed, but it faced a severe problem in the movie projection to the target building. Extra tents were set in front of the target building, and the tents became obstacles to the movie projection. The simulation tool developed herein could reconstruct the problems of the event. Therefore, if the simulation tool was developed before the 2019 projection mapping event, the problem of the tents being obstacles could have been avoided using the tool. Moreover, we confirmed that the simulation tool is useful for planning future projection mapping events to avoid various extra equipment obstacles, such as utility poles, planting trees, and monument towers.

Keywords: avoiding obstacles, projection mapping, projector position, real 3D map

References:

[1] N. Hanakawa, “An education model for project-based learning using ability map in various target products,” the 27th Asia Pac. Software Eng. Conf. (APSEC2020), Dec. 2020, pp. 296–305.
[2] Available at: https://docs.mapbox.com/jp/android/maps/overview/, 17/07/2021.
[3] Available at: https://unity.com/ja, 17/07/2021.
[4] G. Qinglian and N. Matsui, “Three indispensable shapes supporting a successful projection mapping,” Kit Prog., vol. 27, Mar. 21–30, 2019.
[5] G. Qinglian and H. Nagasse, “Component technologies and education activities required for projection mapping,” Kit Prog., vol. 26, 41–51 Mar, 2018.
[6] K. Battulga and T. Fujimoto, “View-dependent projection mapping enhanced by real background,” J. Soc. Art Sci., vol. 20, no. 1, pp. 55–71.
[7] S. Shimazu, D. Iwai, and K. Sato, “Optimal placement of multiple projectors for projection based mixed reality by considering spatial resolution,” Transaction of Virtual Reality Society Japan, vol. 17, no. 3. 261–268, 2012.
[8] Available at: https://youtu.be/Zp6ITYW93ok, 17/07/2021.
[9] Available at: https://youtu.be/WLORt17r4gA, 17/07/2021