Multimedia Firearms Training System

Authors: Aleksander Nawrat, Karol Jędrasiak, Artur Ryt, Dawid Sobel

Abstract:

The goal of the article is to present a novel Multimedia Firearms Training System. The system was developed in order to compensate for major problems of existing shooting training systems. The designed and implemented solution can be characterized by five major advantages: algorithm for automatic geometric calibration, algorithm of photometric recalibration, firearms hit point detection using thermal imaging camera, IR laser spot tracking algorithm for after action review analysis, and implementation of ballistics equations. The combination of the abovementioned advantages in a single multimedia firearms training system creates a comprehensive solution for detecting and tracking of the target point usable for shooting training systems and improving intervention tactics of uniformed services. The introduced algorithms of geometric and photometric recalibration allow the use of economically viable commercially available projectors for systems that require long and intensive use without most of the negative impacts on color mapping of existing multi-projector multimedia shooting range systems. The article presents the results of the developed algorithms and their application in real training systems.

Keywords: Firearms shot detection, geometric recalibration, photometric recalibration, IR tracking algorithm, thermography, ballistics.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1127627

References:

[1] Internet source: http://www.sst-germany.de/, access date: 18.06.2016
[2] Internet source: http://www.lasershot.com/government-military, access date: 18.06.2016
[3] Majumder, Aditi, Duy-Quoc Lai, and Mahdi Abbaspour Tehrani. "A multi-projector display system of arbitrary shape, size and resolution." ACM SIGGRAPH 2015 Emerging Technologies. ACM, 2015.
[4] Sajadi, Behzad, and Aditi Majumder. "Markerless view-independent registration of multiple distorted projectors on extruded surfaces using an uncalibrated camera." Visualization and Computer Graphics, IEEE Transactions on 15.6 (2009): 1307-1316.
[5] Bhasker, Ezekiel, Ray Juang, and Aditi Majumder. "Registration techniques for using imperfect and par tially calibrated devices in planar multi-projector displays." Visualization and Computer Graphics, IEEE Transactions on 13.6 (2007): 1368-1375.
[6] Sajadi, Behzad, et al. "Color seamlessness in multi-projector displays using constrained gamut morphing." Visualization and Computer Graphics, IEEE Transactions on 15.6 (2009): 1317-1326.
[7] J. Gacek: Balistyka zewnętrzna Cz. 1, Modelowanie zjawisk balistyki zewnętrznej i dynamiki lotu, Warszawa, 1997
[8] B. Litz: Applied Ballistics for Long Range Shooting: Understanding the elements and application of external ballistics for successful long range target shooting and Hunting,
[9] Yilmaz, Alper, Omar Javed, and Mubarak Shah. "Object tracking: A survey."Acm computing surveys (CSUR) 38.4 (2006): 13.
[10] Wu, Yi, Jongwoo Lim, and Ming-Hsuan Yang. "Online object tracking: A benchmark." Proceedings of the IEEE conference on computer vision and pattern recognition. 2013.
[11] Yang, Fan, Huchuan Lu, and Yen-Wei Chen. "Bag of features tracking." Pattern Recognition (ICPR), 2010 20th International Conference on. IEEE, 2010.
[12] Kwon, Junseok, and Kyoung Mu Lee. "Visual tracking decomposition." Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on. IEEE, 2010.
[13] Oron, Shaul, et al. "Locally orderless tracking." International Journal of Computer Vision 111.2 (2015): 213-228.
[14] Ryt, Artur, et al. "Real-time laser point tracking." Computer Vision and Graphics. Springer International Publishing, 2014. 542-551.
[15] Color Seamlessness in Multi-Projector Displays Using Constrained Gamut Morphing, Behzad Sajadi, Student Member, IEEE, Maxim Lazarov, Aditi Majumder, Member, IEEE, and M. Gopi
[16] Perceptual photometric seamlessness in tiled projection-based displays, A. Majumder and R. Stevens.
[17] Bhagat, Kaushal Kumar, Wei-Kai Liou, and Chun-Yen Chang. "A cost-effective interactive 3D virtual reality system applied to military live firing training." Virtual Reality 20.2 (2016): 127-140.
[18] Sobel D., Kwiatkowski J., Ryt A., Domzal M., Jedrasiak K., Janik L., Nawrat A., The System for Augmented Reality Motion Measurements Visualization, vol. 33, Studies in Systems, Decision and Control, pp. 189-200, Springer International Publishing, ISBN: 978-3-319-21117-6, 2015.
[19] Wilk P., Targiel T., Sobel D., Kwiatkowski J., Jedrasiak K., Nawrat A., The Concept of an Active Thermal Camouflage for Friend-Foe Identification System, Innovative Simulation Systems, vol. 33, Studies in Systems, Decision and Control, pp. 67-76, Springer International Publishing, ISBN: 978-3-319-21117-6, 2015.
[20] Sobel D., Jedrasiak K., Daniec K., Wrona J., Jurgaś P, Nawrat AM, Camera Calibration for Tracked Vehicles Augmented Reality Applications, Innovative Control Systems for Tracked Vehicle Platforms, vol. 2, pp. 147-162, ISBN (Print) 978-3-319-04623-5, ISBN (Online) 978-3-319-04624-2, 2014.
[21] Demski, P., Grzejszczak, T., Jedrasiak, K., Mikulski, M., Automatic Targeting Sentry Turret for Distributed Systems, Vision Based Systems for UAV Applications, ISBN: 978-3-319-00368-9, pp. 47-55, Springer-Verlag, 2013.
[22] Jędrasiak K., Nawrat A., The Comparison of Capabilities of Low Light Camera, Thermal Imaging Camera and Depth Map Camera for Night Time Surveillance Applications, Advanced Technologies for Intelligent Systems of National Border Security, Ed. by A. Nawrat, K. Simek, A. Świerniak. Berlin: Springer, Studies in Computational Intelligence; vol. 440 1860-949X, ISBN 978-364-231-664-7, pp. 117-128, 2012.
[23] Internet source: http://www.fmwconcepts.com/imagemagick/bilinearwarp/index.php, access date: 10.06.2016