Automation of the Maritime UAV Command, Control, Navigation Operations, Simulated in Real-Time Using Kinect Sensor: A Feasibility Study

Authors: Regius Asiimwe, Amir Anvar

Abstract:

This paper describes the process used in the automation of the Maritime UAV commands using the Kinect sensor. The AR Drone is a Quadrocopter manufactured by Parrot [1] to be controlled using the Apple operating systems such as iPhones and Ipads. However, this project uses the Microsoft Kinect SDK and Microsoft Visual Studio C# (C sharp) software, which are compatible with Windows Operating System for the automation of the navigation and control of the AR drone. The navigation and control software for the Quadrocopter runs on a windows 7 computer. The project is divided into two sections; the Quadrocopter control system and the Kinect sensor control system. The Kinect sensor is connected to the computer using a USB cable from which commands can be sent to and from the Kinect sensors. The AR drone has Wi-Fi capabilities from which it can be connected to the computer to enable transfer of commands to and from the Quadrocopter. The project was implemented in C#, a programming language that is commonly used in the automation systems. The language was chosen because there are more libraries already established in C# for both the AR drone and the Kinect sensor. The study will contribute toward research in automation of systems using the Quadrocopter and the Kinect sensor for navigation involving a human operator in the loop. The prototype created has numerous applications among which include the inspection of vessels such as ship, airplanes and areas that are not accessible by human operators.

Keywords: UAV, AR drone, Kinect Sensors, Automation, Real time, C sharp, Microsoft Kinect SDK.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1061533

References:

[1] (2012). Parrot AR. Drone, flying Video Game, Developer SDK 1.5. Parrot Company.
[2] Adam Salamon, D. H. (2008). Increasing Situational Awareness Through The Use Of Uxv Teams While Reducing Operator Workload. Lockheed Martin.
[3] Crawford, S. (2012, October 1). How Microsoft Kinect Works. Retrieved 10 1, 2012, from How stuf fworks: http://electronics.howstuffworks.com/microsoft-kinect2.htm
[4] Drone, P. A. (2012). www.Parrot.com. Retrieved 10 2, 2012, from A Technological first : http://ardrone.parrot.com/parrot-ardrone/ en/technologies
[5] John Stowers, M. H.-S. (2011). Quadrotor Helicopter Flight Control Using Hough Transform and Depth Map from a Microsoft Kinect Sensor. Conference on Machine Vision Applications, Nara, JAPAN, 5.
[6] Mariusz Wzorek, D. L. (2006). GSM Technology as a Communication Media for an Autonomous Unmanned Aerial Vehicle. 21th Bristol UAV Systems Conference, (p. 15). Link¨oping, Sweden.
[7] Masako Kumano, A. O. (2000). Obstacle Avoidance of Autonomous Mobile Robot using Stereo Vision Sensor. 6.
[8] Parrot. (2012). Parrot AR. Drone Overview.
[9] Pierre-Jean Bristeau, F. C. (2011). The Navigation and Control technology inside the AR.Drone micro UAV. 18th IFAC World Congress, (p. 8). Milano, Italy.
[10] Robotics, M. (2012). Kinect Sensor. Retrieved 10 1, 2012, from Microsoft: http://msdn.microsoft.com/en-us/library/hh438998.aspx
[11] Sandler, A. A. (2012). How to Control AR.Drone Movements During Flight. Retrieved 10 1, 2012, from Robot -App Developers: http://www.robotappstore.com/Knowledge-Base/How-to-Make- ARDrone-Take-Off-or-Land/97.html
[12] Totilo, S. (2010, 11 4). Review: Kinect. Retrieved 10 11, 2012, from kotaku: http://kotaku.com/5680501/review-kinect
[13] Walter Hickey, R. J. (2012, 08 17). These Ships Have Russia Considering A Missile Strike Against Europe. Retrieved 10 11, 2012, from Business Inside, Military and Defence: http://www.businessinsider.com/meet-the-destroyers-that-are-thelynchpin- of-the-european-missile-shield-2012-8?op=1