A Real-Time Pinch-to-Zoom Motion Detection by Means of a Surface EMG-Based Human-Computer Interface

In this paper, we propose a system for inferring the pinch-to-zoom gesture using surface EMG (Electromyography) signals in real time. Pinch-to-zoom, which is a common gesture in smart devices such as an iPhone or an Android phone, is used to control the size of images or web pages according to the d...

Full description

Bibliographic Details
Main Authors: Jongin Kim, Dongrae Cho, Kwang Jin Lee, Boreom Lee
Format: Article
Language:English
Published: MDPI AG 2014-12-01
Series:Sensors
Subjects:
Online Access:http://www.mdpi.com/1424-8220/15/1/394
id doaj-61e4fc9a5e974a528aeaa1156ea922fc
record_format Article
spelling doaj-61e4fc9a5e974a528aeaa1156ea922fc2020-11-24T23:58:05ZengMDPI AGSensors1424-82202014-12-0115139440710.3390/s150100394s150100394A Real-Time Pinch-to-Zoom Motion Detection by Means of a Surface EMG-Based Human-Computer InterfaceJongin Kim0Dongrae Cho1Kwang Jin Lee2Boreom Lee3Department of Medical System Engineering (DMSE), Gwangju Institute of Science and Technology (GIST), Gwangju 500-712, KoreaSchool of Mechatronics, Gwangju Institute of Science and Technology (GIST), Gwangju 500-712, KoreaDepartment of Medical System Engineering (DMSE), Gwangju Institute of Science and Technology (GIST), Gwangju 500-712, KoreaDepartment of Medical System Engineering (DMSE), Gwangju Institute of Science and Technology (GIST), Gwangju 500-712, KoreaIn this paper, we propose a system for inferring the pinch-to-zoom gesture using surface EMG (Electromyography) signals in real time. Pinch-to-zoom, which is a common gesture in smart devices such as an iPhone or an Android phone, is used to control the size of images or web pages according to the distance between the thumb and index finger. To infer the finger motion, we recorded EMG signals obtained from the first dorsal interosseous muscle, which is highly related to the pinch-to-zoom gesture, and used a support vector machine for classification between four finger motion distances. The powers which are estimated by Welch’s method were used as feature vectors. In order to solve the multiclass classification problem, we applied a one-versus-one strategy, since a support vector machine is basically a binary classifier. As a result, our system yields 93.38% classification accuracy averaged over six subjects. The classification accuracy was estimated using 10-fold cross validation. Through our system, we expect to not only develop practical prosthetic devices but to also construct a novel user experience (UX) for smart devices.http://www.mdpi.com/1424-8220/15/1/394surface EMGpinch-to-zoomfinger gesture recognitionmachine learningsupport vector machinemulti-class classification
collection DOAJ
language English
format Article
sources DOAJ
author Jongin Kim
Dongrae Cho
Kwang Jin Lee
Boreom Lee
spellingShingle Jongin Kim
Dongrae Cho
Kwang Jin Lee
Boreom Lee
A Real-Time Pinch-to-Zoom Motion Detection by Means of a Surface EMG-Based Human-Computer Interface
Sensors
surface EMG
pinch-to-zoom
finger gesture recognition
machine learning
support vector machine
multi-class classification
author_facet Jongin Kim
Dongrae Cho
Kwang Jin Lee
Boreom Lee
author_sort Jongin Kim
title A Real-Time Pinch-to-Zoom Motion Detection by Means of a Surface EMG-Based Human-Computer Interface
title_short A Real-Time Pinch-to-Zoom Motion Detection by Means of a Surface EMG-Based Human-Computer Interface
title_full A Real-Time Pinch-to-Zoom Motion Detection by Means of a Surface EMG-Based Human-Computer Interface
title_fullStr A Real-Time Pinch-to-Zoom Motion Detection by Means of a Surface EMG-Based Human-Computer Interface
title_full_unstemmed A Real-Time Pinch-to-Zoom Motion Detection by Means of a Surface EMG-Based Human-Computer Interface
title_sort real-time pinch-to-zoom motion detection by means of a surface emg-based human-computer interface
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2014-12-01
description In this paper, we propose a system for inferring the pinch-to-zoom gesture using surface EMG (Electromyography) signals in real time. Pinch-to-zoom, which is a common gesture in smart devices such as an iPhone or an Android phone, is used to control the size of images or web pages according to the distance between the thumb and index finger. To infer the finger motion, we recorded EMG signals obtained from the first dorsal interosseous muscle, which is highly related to the pinch-to-zoom gesture, and used a support vector machine for classification between four finger motion distances. The powers which are estimated by Welch’s method were used as feature vectors. In order to solve the multiclass classification problem, we applied a one-versus-one strategy, since a support vector machine is basically a binary classifier. As a result, our system yields 93.38% classification accuracy averaged over six subjects. The classification accuracy was estimated using 10-fold cross validation. Through our system, we expect to not only develop practical prosthetic devices but to also construct a novel user experience (UX) for smart devices.
topic surface EMG
pinch-to-zoom
finger gesture recognition
machine learning
support vector machine
multi-class classification
url http://www.mdpi.com/1424-8220/15/1/394
work_keys_str_mv AT jonginkim arealtimepinchtozoommotiondetectionbymeansofasurfaceemgbasedhumancomputerinterface
AT dongraecho arealtimepinchtozoommotiondetectionbymeansofasurfaceemgbasedhumancomputerinterface
AT kwangjinlee arealtimepinchtozoommotiondetectionbymeansofasurfaceemgbasedhumancomputerinterface
AT boreomlee arealtimepinchtozoommotiondetectionbymeansofasurfaceemgbasedhumancomputerinterface
AT jonginkim realtimepinchtozoommotiondetectionbymeansofasurfaceemgbasedhumancomputerinterface
AT dongraecho realtimepinchtozoommotiondetectionbymeansofasurfaceemgbasedhumancomputerinterface
AT kwangjinlee realtimepinchtozoommotiondetectionbymeansofasurfaceemgbasedhumancomputerinterface
AT boreomlee realtimepinchtozoommotiondetectionbymeansofasurfaceemgbasedhumancomputerinterface
_version_ 1725451989493481472