Faster Command Input Using the Multimodal Controller Working Position “TriControl”

• Main Authors: Oliver Ohneiser, Malte Jauer, Jonathan R. Rein, Matt Wallace
• Format: Article
• Language: English
• Published: MDPI AG 2018-05-01
• Series: Aerospace
• Subjects: air traffic controller; human machine interaction; human computer interaction; multimodality; eye tracking; automatic speech recognition; multi-touch gestures; controller command; speed gain
• Online Access: http://www.mdpi.com/2226-4310/5/2/54

TriControl is a controller working position (CWP) prototype developed by German Aerospace Center (DLR) to enable more natural, efficient, and faster command inputs. The prototype integrates three input modalities: speech recognition, eye tracking, and multi-touch sensing. Air traffic controllers may use all three modalities simultaneously to build commands that will be forwarded to the pilot and to the air traffic management (ATM) system. This paper evaluates possible speed improvements of TriControl compared to conventional systems involving voice transmission and manual data entry. 26 air traffic controllers participated in one of two air traffic control simulation sub-studies, one with each input system. Results show potential of a 15% speed gain for multimodal controller command input in contrast to conventional inputs. Thus, the use and combination of modern human machine interface (HMI) technologies at the CWP can increase controller productivity.