A Novel Gesture Recognition System for Intelligent Interaction with a Nursing-Care Assistant Robot

• Main Authors: Geng Yang, Honghao Lv, Feiyu Chen, Zhibo Pang, Jin Wang, Huayong Yang, Junhui Zhang
• Format: Article
• Language: English
• Published: MDPI AG 2018-11-01
• Series: Applied Sciences
• Subjects: HMT gesture recognition; smart infrastructure; nursing-care assistant robot; wearable wrist-worn camera; continuous gesture segmentation; human–robot interaction
• Online Access: https://www.mdpi.com/2076-3417/8/12/2349

The expansion of nursing-care assistant robots in smart infrastructure has provided more applications for homecare services, which has raised new demands for smart and natural interaction between humans and robots. This article proposed an innovative hand motion trajectory (HMT) gesture recognition system based on background velocity features. Here, a new wearable wrist-worn camera prototype for gesture’s video collection was designed, and a new method for the segmentation of continuous gestures was shown. Meanwhile, a nursing-care assistant robot prototype was designed for assisting the elderly, which is capable of carrying the elderly with omnidirectional motion and grabbing the specified object at home. In order to evaluate the performance of the gesture recognition system, 10 special gestures were defined as the move commands for interaction with the robot, and 1000 HMT gesture samples were obtained from five subjects for leave-one-subject-out (LOSO) cross-validation classification with an average recognition accuracy of up to 97.34%. Moreover, the performance and practicability of the proposed system were further demonstrated by controlling the omnidirectional movement of the nursing-care assistant robot using the predefined gesture commands.