sEMG-Based Continuous Estimation of Finger Kinematics via Large-Scale Temporal Convolutional Network

Since continuous motion control can provide a more natural, fast and accurate man–machine interface than that of discrete motion control, it has been widely used in human–robot cooperation (HRC). Among various biological signals, the surface electromyogram (sEMG)—the signal of actions potential supe...

Full description

Bibliographic Details
Main Authors: Chao Chen, Weiyu Guo, Chenfei Ma, Yongkui Yang, Zheng Wang, Chuang Lin
Format: Article
Language:English
Published: MDPI AG 2021-05-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/11/10/4678
id doaj-f0979589062c4ea38ad3e6ece731dd3f
record_format Article
spelling doaj-f0979589062c4ea38ad3e6ece731dd3f2021-06-01T00:33:34ZengMDPI AGApplied Sciences2076-34172021-05-01114678467810.3390/app11104678sEMG-Based Continuous Estimation of Finger Kinematics via Large-Scale Temporal Convolutional NetworkChao Chen0Weiyu Guo1Chenfei Ma2Yongkui Yang3Zheng Wang4Chuang Lin5Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518000, ChinaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518000, ChinaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518000, ChinaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518000, ChinaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518000, ChinaSchool of Information Science and Technology, Dalian Maritime University, Dalian 116026, ChinaSince continuous motion control can provide a more natural, fast and accurate man–machine interface than that of discrete motion control, it has been widely used in human–robot cooperation (HRC). Among various biological signals, the surface electromyogram (sEMG)—the signal of actions potential superimposed on the surface of the skin containing the temporal and spatial information—is one of the best signals with which to extract human motion intentions. However, most of the current sEMG control methods can only perform discrete motion estimation, and thus fail to meet the requirements of continuous motion estimation. In this paper, we propose a novel method that applies a temporal convolutional network (TCN) to sEMG-based continuous estimation. After analyzing the relationship between the convolutional kernel’s size and the lengths of atomic segments (defined in this paper), we propose a large-scale temporal convolutional network (LS-TCN) to overcome the TCN’s problem: that it is difficult to fully extract the sEMG’s temporal features. When applying our proposed LS-TCN with a convolutional kernel size of 1 × 31 to continuously estimate the angles of the 10 main joints of fingers (based on the public dataset Ninapro), it can achieve a precision rate of 71.6%. Compared with TCN (kernel size of 1 × 3), LS-TCN (kernel size of 1 × 31) improves the precision rate by 6.6%.https://www.mdpi.com/2076-3417/11/10/4678temporal convolutional networkhuman–robot cooperationsurface electromyogramcontinuous motion estimation
collection DOAJ
language English
format Article
sources DOAJ
author Chao Chen
Weiyu Guo
Chenfei Ma
Yongkui Yang
Zheng Wang
Chuang Lin
spellingShingle Chao Chen
Weiyu Guo
Chenfei Ma
Yongkui Yang
Zheng Wang
Chuang Lin
sEMG-Based Continuous Estimation of Finger Kinematics via Large-Scale Temporal Convolutional Network
Applied Sciences
temporal convolutional network
human–robot cooperation
surface electromyogram
continuous motion estimation
author_facet Chao Chen
Weiyu Guo
Chenfei Ma
Yongkui Yang
Zheng Wang
Chuang Lin
author_sort Chao Chen
title sEMG-Based Continuous Estimation of Finger Kinematics via Large-Scale Temporal Convolutional Network
title_short sEMG-Based Continuous Estimation of Finger Kinematics via Large-Scale Temporal Convolutional Network
title_full sEMG-Based Continuous Estimation of Finger Kinematics via Large-Scale Temporal Convolutional Network
title_fullStr sEMG-Based Continuous Estimation of Finger Kinematics via Large-Scale Temporal Convolutional Network
title_full_unstemmed sEMG-Based Continuous Estimation of Finger Kinematics via Large-Scale Temporal Convolutional Network
title_sort semg-based continuous estimation of finger kinematics via large-scale temporal convolutional network
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2021-05-01
description Since continuous motion control can provide a more natural, fast and accurate man–machine interface than that of discrete motion control, it has been widely used in human–robot cooperation (HRC). Among various biological signals, the surface electromyogram (sEMG)—the signal of actions potential superimposed on the surface of the skin containing the temporal and spatial information—is one of the best signals with which to extract human motion intentions. However, most of the current sEMG control methods can only perform discrete motion estimation, and thus fail to meet the requirements of continuous motion estimation. In this paper, we propose a novel method that applies a temporal convolutional network (TCN) to sEMG-based continuous estimation. After analyzing the relationship between the convolutional kernel’s size and the lengths of atomic segments (defined in this paper), we propose a large-scale temporal convolutional network (LS-TCN) to overcome the TCN’s problem: that it is difficult to fully extract the sEMG’s temporal features. When applying our proposed LS-TCN with a convolutional kernel size of 1 × 31 to continuously estimate the angles of the 10 main joints of fingers (based on the public dataset Ninapro), it can achieve a precision rate of 71.6%. Compared with TCN (kernel size of 1 × 3), LS-TCN (kernel size of 1 × 31) improves the precision rate by 6.6%.
topic temporal convolutional network
human–robot cooperation
surface electromyogram
continuous motion estimation
url https://www.mdpi.com/2076-3417/11/10/4678
work_keys_str_mv AT chaochen semgbasedcontinuousestimationoffingerkinematicsvialargescaletemporalconvolutionalnetwork
AT weiyuguo semgbasedcontinuousestimationoffingerkinematicsvialargescaletemporalconvolutionalnetwork
AT chenfeima semgbasedcontinuousestimationoffingerkinematicsvialargescaletemporalconvolutionalnetwork
AT yongkuiyang semgbasedcontinuousestimationoffingerkinematicsvialargescaletemporalconvolutionalnetwork
AT zhengwang semgbasedcontinuousestimationoffingerkinematicsvialargescaletemporalconvolutionalnetwork
AT chuanglin semgbasedcontinuousestimationoffingerkinematicsvialargescaletemporalconvolutionalnetwork
_version_ 1721414562941501440