Hand Gesture Recognition on a Resource-Limited Interactive Wristband

Most of the reported hand gesture recognition algorithms require high computational resources, i.e., fast MCU frequency and significant memory, which are highly inapplicable to the cost-effectiveness of consumer electronics products. This paper proposes a hand gesture recognition algorithm running o...

Full description

Bibliographic Details
Main Authors: Shenglin Zhao, Haoyuan Cai, Wenkuan Li, Yaqian Liu, Chunxiu Liu
Format: Article
Language:English
Published: MDPI AG 2021-08-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/17/5713
id doaj-ed203b8f96eb493f84701007308baff0
record_format Article
spelling doaj-ed203b8f96eb493f84701007308baff02021-09-09T13:55:56ZengMDPI AGSensors1424-82202021-08-01215713571310.3390/s21175713Hand Gesture Recognition on a Resource-Limited Interactive WristbandShenglin Zhao0Haoyuan Cai1Wenkuan Li2Yaqian Liu3Chunxiu Liu4State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, ChinaState Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, ChinaState Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, ChinaState Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, ChinaState Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, ChinaMost of the reported hand gesture recognition algorithms require high computational resources, i.e., fast MCU frequency and significant memory, which are highly inapplicable to the cost-effectiveness of consumer electronics products. This paper proposes a hand gesture recognition algorithm running on an interactive wristband, with computational resource requirements as low as Flash < 5 KB, RAM < 1 KB. Firstly, we calculated the three-axis linear acceleration by fusing accelerometer and gyroscope data with a complementary filter. Then, by recording the order of acceleration vectors crossing axes in the world coordinate frame, we defined a new feature code named axis-crossing code. Finally, we set templates for eight hand gestures to recognize new samples. We compared this algorithm’s performance with the widely used dynamic time warping (DTW) algorithm and recurrent neural network (BiLSTM and GRU). The results show that the accuracies of the proposed algorithm and RNNs are higher than DTW and that the time cost of the proposed algorithm is much less than those of DTW and RNNs. The average recognition accuracy is 99.8% on the collected dataset and 97.1% in the actual user-independent case. In general, the proposed algorithm is suitable and competitive in consumer electronics. This work has been volume-produced and patent-granted.https://www.mdpi.com/1424-8220/21/17/5713complementary filterdynamic time warping (DTW)hand gesture recognition (HGR)inertial measurement unit (IMU)interactive wristbandrecurrent neural network (RNN)
collection DOAJ
language English
format Article
sources DOAJ
author Shenglin Zhao
Haoyuan Cai
Wenkuan Li
Yaqian Liu
Chunxiu Liu
spellingShingle Shenglin Zhao
Haoyuan Cai
Wenkuan Li
Yaqian Liu
Chunxiu Liu
Hand Gesture Recognition on a Resource-Limited Interactive Wristband
Sensors
complementary filter
dynamic time warping (DTW)
hand gesture recognition (HGR)
inertial measurement unit (IMU)
interactive wristband
recurrent neural network (RNN)
author_facet Shenglin Zhao
Haoyuan Cai
Wenkuan Li
Yaqian Liu
Chunxiu Liu
author_sort Shenglin Zhao
title Hand Gesture Recognition on a Resource-Limited Interactive Wristband
title_short Hand Gesture Recognition on a Resource-Limited Interactive Wristband
title_full Hand Gesture Recognition on a Resource-Limited Interactive Wristband
title_fullStr Hand Gesture Recognition on a Resource-Limited Interactive Wristband
title_full_unstemmed Hand Gesture Recognition on a Resource-Limited Interactive Wristband
title_sort hand gesture recognition on a resource-limited interactive wristband
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2021-08-01
description Most of the reported hand gesture recognition algorithms require high computational resources, i.e., fast MCU frequency and significant memory, which are highly inapplicable to the cost-effectiveness of consumer electronics products. This paper proposes a hand gesture recognition algorithm running on an interactive wristband, with computational resource requirements as low as Flash < 5 KB, RAM < 1 KB. Firstly, we calculated the three-axis linear acceleration by fusing accelerometer and gyroscope data with a complementary filter. Then, by recording the order of acceleration vectors crossing axes in the world coordinate frame, we defined a new feature code named axis-crossing code. Finally, we set templates for eight hand gestures to recognize new samples. We compared this algorithm’s performance with the widely used dynamic time warping (DTW) algorithm and recurrent neural network (BiLSTM and GRU). The results show that the accuracies of the proposed algorithm and RNNs are higher than DTW and that the time cost of the proposed algorithm is much less than those of DTW and RNNs. The average recognition accuracy is 99.8% on the collected dataset and 97.1% in the actual user-independent case. In general, the proposed algorithm is suitable and competitive in consumer electronics. This work has been volume-produced and patent-granted.
topic complementary filter
dynamic time warping (DTW)
hand gesture recognition (HGR)
inertial measurement unit (IMU)
interactive wristband
recurrent neural network (RNN)
url https://www.mdpi.com/1424-8220/21/17/5713
work_keys_str_mv AT shenglinzhao handgesturerecognitiononaresourcelimitedinteractivewristband
AT haoyuancai handgesturerecognitiononaresourcelimitedinteractivewristband
AT wenkuanli handgesturerecognitiononaresourcelimitedinteractivewristband
AT yaqianliu handgesturerecognitiononaresourcelimitedinteractivewristband
AT chunxiuliu handgesturerecognitiononaresourcelimitedinteractivewristband
_version_ 1717759468080463872