IMU Sensor-Based Hand Gesture Recognition for Human-Machine Interfaces

• Main Authors: Minwoo Kim, Jaechan Cho, Seongjoo Lee, Yunho Jung
• Format: Article
• Language: English
• Published: MDPI AG 2019-09-01
• Series: Sensors
• Subjects: dynamic time warping (DTW); hand gesture recognition (HGR); inertial measurement unit (IMU); machine learning; real-time learning; restricted coulomb energy (RCE) neural network
• Online Access: https://www.mdpi.com/1424-8220/19/18/3827

We propose an efficient hand gesture recognition (HGR) algorithm, which can cope with time-dependent data from an inertial measurement unit (IMU) sensor and support real-time learning for various human-machine interface (HMI) applications. Although the data extracted from IMU sensors are time-dependent, most existing HGR algorithms do not consider this characteristic, which results in the degradation of recognition performance. Because the dynamic time warping (DTW) technique considers the time-dependent characteristic of IMU sensor data, the recognition performance of DTW-based algorithms is better than that of others. However, the DTW technique requires a very complex learning algorithm, which makes it difficult to support real-time learning. To solve this issue, the proposed HGR algorithm is based on a restricted column energy (RCE) neural network, which has a very simple learning scheme in which neurons are activated when necessary. By replacing the metric calculation of the RCE neural network with DTW distance, the proposed algorithm exhibits superior recognition performance for time-dependent sensor data while supporting real-time learning. Our verification results on a field-programmable gate array (FPGA)-based test platform show that the proposed HGR algorithm can achieve a recognition accuracy of 98.6% and supports real-time learning and recognition at an operating frequency of 150 MHz.