Design of an Active Vision System for High-Level Isolation Units through Q-Learning

• Main Authors: Andrea Gil Ruiz, Juan G. Victores, Bartek Łukawski, Carlos Balaguer
• Format: Article
• Language: English
• Published: MDPI AG 2020-08-01
• Series: Applied Sciences
• Subjects: reinforcement learning; personal protective equipment; Q-Learning; reward shaping; grid search; healthcare
• Online Access: https://www.mdpi.com/2076-3417/10/17/5927

The inspection of Personal Protective Equipment (PPE) is one of the most necessary measures when treating patients affected by infectious diseases, such as Ebola or COVID-19. Assuring the integrity of health personnel in contact with infected patients has become an important concern in developed countries. This work focuses on the study of Reinforcement Learning (RL) techniques for controlling a scanner prototype in the presence of blood traces on the PPE that could arise after contact with pathological patients. A preliminary study on the design of an agent-environment system able to simulate the required task is presented. The task has been adapted to an environment for the OpenAI Gym toolkit. The evaluation of the agent’s performance has considered the effects of different topological designs and tuning hyperparameters of the Q-Learning model-free algorithm. Results have been evaluated on the basis of average reward and timesteps per episode. The sample-average method applied to the learning rate parameter, as well as a specific epsilon decaying method worked best for the trained agents. The obtained results report promising outcomes of an inspection system able to center and magnify contaminants in the real scanner system.