Automated, Objective Assessment of Pilot Performance in Simulated Environment

Authors: Maciej Zasuwa, Grzegorz Ptasinski, Antoni Kopyt

Abstract:

Nowadays flight simulators offer tremendous possibilities for safe and cost-effective pilot training, by utilization of powerful, computational tools. Due to technology outpacing methodology, vast majority of training related work is done by human instructors. It makes assessment not efficient, and vulnerable to instructors’ subjectivity. The research presents an Objective Assessment Tool (gOAT) developed at the Warsaw University of Technology, and tested on SW-4 helicopter flight simulator. The tool uses database of the predefined manoeuvres, defined and integrated to the virtual environment. These were implemented, basing on Aeronautical Design Standard Performance Specification Handling Qualities Requirements for Military Rotorcraft (ADS-33), with predefined Mission-Task-Elements (MTEs). The core element of the gOAT enhanced algorithm that provides instructor a new set of information. In details, a set of objective flight parameters fused with report about psychophysical state of the pilot. While the pilot performs the task, the gOAT system automatically calculates performance using the embedded algorithms, data registered by the simulator software (position, orientation, velocity, etc.), as well as measurements of physiological changes of pilot’s psychophysiological state (temperature, sweating, heart rate). Complete set of measurements is presented on-line to instructor’s station and shown in dedicated graphical interface. The presented tool is based on open source solutions, and flexible for editing. Additional manoeuvres can be easily added using guide developed by authors, and MTEs can be changed by instructor even during an exercise. Algorithm and measurements used allow not only to implement basic stress level measurements, but also to reduce instructor’s workload significantly. Tool developed can be used for training purpose, as well as periodical checks of the aircrew. Flexibility and ease of modifications allow the further development to be wide ranged, and the tool to be customized. Depending on simulation purpose, gOAT can be adjusted to support simulator of aircraft, helicopter, or unmanned aerial vehicle (UAV).

Keywords: Automated assessment, flight simulator, human factors, pilot training.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.2643561

References:

[1] EHEST, "Teaching and Testing in Flight Simulation Training Devices (FSTD)," EASA, Koln.
[2] P. J. D. V. Podofillini L., "Measuring the influence of task complexity on human error probability: an empirical evaluation" Nuclear Engineering and Technology, pp. 151-164, 1 April 2013.
[3] L. M. G. A. S. L. M. R. Horrey W., "Distraction and task engagement: How interesting and boring information impact driving performance and subjective and physiological responses" Applied Ergonomics, pp. 342-348, January 2017.
[4] HOH Aerospace, "Aeronautical Design Standard Performance Specification Handling Qualities Requirements for Military Rotorcraft," United States Army Aviation and Missile Command Aviation Engineering Directorate, Redstone Arsenal, Alabama, 2000.
[5] N. J. Zasuwa M., "Integrating Dynamic Models of Mobile Objects with Reconfigurable Simulator," in Proceedings of 5th International Conference Supply on the Wings, Frankfurt, 2010.
[6] K. M. Kohzoh Yoshino, "Correlation between mood and heart rate variability," Health, pp. 553-556, 2017 August 17.
[7] S. Terathongkum, Relationships Among Stress, Blood Pressure, and Heart Rate Variability in Meditators., Virginia Commonwealth University, 2006.
[8] M. Campos, "Heart rate variability: A new way to track well-being.," Harvard Health Publishing, 2017.
[9] Z. K. K. M. A. J. Kwarecki K., "Zmienność Częstości Skurczów Serca u Pilotów Komunikacyjnych w Realnym Locie" Medycyna Lotnicza, pp. 120-121, 1993.
[10] T. U. G. M. F. J. S. D. H. J. Heinze C., "Circadian Rhythms in Heart Rate Measures," in Proceedings of the 6th ESGCO, Berlin, 2010.
[11] R. Celi, "Optimization-based inverse simulation of a helicopter slalom maneuver" Department of Aerospace Engineering University of Maryland, College Park.