A New Markov Decision Process Based Behavioral Prediction System for Airborne Crews

In order to ensure the normal and stable flights in the aircraft, a variety of sensors and corresponding instrumentation systems have been applied on the aircraft to monitor/control the current flight status, and the resulted data ensure the flight safety with a heavy burden on the pilot. In views o...

Full description

Bibliographic Details
Main Authors: Yaozhong Zhang, Kangjia Yao, Jiandong Zhang, Frank Jiang, Matthew Warren
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8937552/
id doaj-936fe17df1cb435a97eda430ffd33476
record_format Article
spelling doaj-936fe17df1cb435a97eda430ffd334762021-03-30T02:20:37ZengIEEEIEEE Access2169-35362020-01-018280212803210.1109/ACCESS.2019.29612398937552A New Markov Decision Process Based Behavioral Prediction System for Airborne CrewsYaozhong Zhang0https://orcid.org/0000-0001-8074-8753Kangjia Yao1https://orcid.org/0000-0001-6998-4536Jiandong Zhang2https://orcid.org/0000-0001-5136-016XFrank Jiang3https://orcid.org/0000-0003-3088-8525Matthew Warren4https://orcid.org/0000-0002-7529-431XSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi’an, ChinaCentre for Cyber Security Research and Innovation (CSRI), Deakin University, Geelong, VIC, AustraliaCentre for Cyber Security Research and Innovation (CSRI), Deakin University, Geelong, VIC, AustraliaIn order to ensure the normal and stable flights in the aircraft, a variety of sensors and corresponding instrumentation systems have been applied on the aircraft to monitor/control the current flight status, and the resulted data ensure the flight safety with a heavy burden on the pilot. In views of this, nowadays, the aircraft cockpit automation assistance system has become a hot topic. This paper is based on the pilot's future operational behavior which can be predicted through different stages of flight operations after the automated assistance system is triggered, thus providing the pilot with assistance in accordance with his operating habits. We have established a MDP (Markov Decision Process) model via analyzing and modeling of pilot operational behavior and mission requirements for flight processes, and we also use value iterative algorithm to find the optimal prediction sequence, lastly, we verify the operability of the algorithm by flight operation simulation experiment. It provides a new solution for the safety of pilot operations and the intrusiveness of the cockpit adaptive automation assistance system.https://ieeexplore.ieee.org/document/8937552/Cockpit automation assistanceMarkov decision processbehavioral prediction
collection DOAJ
language English
format Article
sources DOAJ
author Yaozhong Zhang
Kangjia Yao
Jiandong Zhang
Frank Jiang
Matthew Warren
spellingShingle Yaozhong Zhang
Kangjia Yao
Jiandong Zhang
Frank Jiang
Matthew Warren
A New Markov Decision Process Based Behavioral Prediction System for Airborne Crews
IEEE Access
Cockpit automation assistance
Markov decision process
behavioral prediction
author_facet Yaozhong Zhang
Kangjia Yao
Jiandong Zhang
Frank Jiang
Matthew Warren
author_sort Yaozhong Zhang
title A New Markov Decision Process Based Behavioral Prediction System for Airborne Crews
title_short A New Markov Decision Process Based Behavioral Prediction System for Airborne Crews
title_full A New Markov Decision Process Based Behavioral Prediction System for Airborne Crews
title_fullStr A New Markov Decision Process Based Behavioral Prediction System for Airborne Crews
title_full_unstemmed A New Markov Decision Process Based Behavioral Prediction System for Airborne Crews
title_sort new markov decision process based behavioral prediction system for airborne crews
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description In order to ensure the normal and stable flights in the aircraft, a variety of sensors and corresponding instrumentation systems have been applied on the aircraft to monitor/control the current flight status, and the resulted data ensure the flight safety with a heavy burden on the pilot. In views of this, nowadays, the aircraft cockpit automation assistance system has become a hot topic. This paper is based on the pilot's future operational behavior which can be predicted through different stages of flight operations after the automated assistance system is triggered, thus providing the pilot with assistance in accordance with his operating habits. We have established a MDP (Markov Decision Process) model via analyzing and modeling of pilot operational behavior and mission requirements for flight processes, and we also use value iterative algorithm to find the optimal prediction sequence, lastly, we verify the operability of the algorithm by flight operation simulation experiment. It provides a new solution for the safety of pilot operations and the intrusiveness of the cockpit adaptive automation assistance system.
topic Cockpit automation assistance
Markov decision process
behavioral prediction
url https://ieeexplore.ieee.org/document/8937552/
work_keys_str_mv AT yaozhongzhang anewmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
AT kangjiayao anewmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
AT jiandongzhang anewmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
AT frankjiang anewmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
AT matthewwarren anewmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
AT yaozhongzhang newmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
AT kangjiayao newmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
AT jiandongzhang newmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
AT frankjiang newmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
AT matthewwarren newmarkovdecisionprocessbasedbehavioralpredictionsystemforairbornecrews
_version_ 1724185310984667136