Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine Learning

Nowadays, rehabilitation training for stroke survivors is mainly completed under the guidance of the physician. There are various treatment ways, however, most of them are affected by various factors such as experience of physician and training intensity. The treatment effect cannot be fed back in t...

Full description

Bibliographic Details
Main Authors: Sheng Miao, Chen Shen, Xiaochen Feng, Qixiu Zhu, Mohammad Shorfuzzaman, Zhihan Lv
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9343271/
id doaj-7538e45c88354bb4926fe073c7400eb4
record_format Article
spelling doaj-7538e45c88354bb4926fe073c7400eb42021-03-30T15:05:02ZengIEEEIEEE Access2169-35362021-01-019302833029110.1109/ACCESS.2021.30559609343271Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine LearningSheng Miao0https://orcid.org/0000-0001-6176-3624Chen Shen1Xiaochen Feng2Qixiu Zhu3Mohammad Shorfuzzaman4https://orcid.org/0000-0002-8050-8431Zhihan Lv5https://orcid.org/0000-0003-2525-3074School of Data Science and Software Engineering, Qingdao University, Qingdao, ChinaSchool of Data Science and Software Engineering, Qingdao University, Qingdao, ChinaDepartment of Rehabilitation, Affiliated Hospital of Qingdao University, Qingdao, ChinaDepartment of Rehabilitation, Affiliated Hospital of Qingdao University, Qingdao, ChinaDepartment of Computer Science, College of Computers and Information Technology, Taif University, Taif, Saudi ArabiaSchool of Data Science and Software Engineering, Qingdao University, Qingdao, ChinaNowadays, rehabilitation training for stroke survivors is mainly completed under the guidance of the physician. There are various treatment ways, however, most of them are affected by various factors such as experience of physician and training intensity. The treatment effect cannot be fed back in time, and objective evaluation data is lacking. In addition, the treatment method is complicated, costly, and highly dependent on physicians. Moreover, stroke survivors' compliance is poor, which leads to various limitations. This paper combines the Internet-of-Things, machine learning, and intelligence system technologies to design a smartphone-based intelligence system to help stroke survivors to improve upper limb rehabilitation. With the built-in multi-modal sensors of the smart phone, training action data of users can be obtained, and then transfer to the server through the Internet. This research presents a DTW-KNN joint algorithm to recognize accuracy of rehabilitation actions and classify to multiple training completion levels. The experimental results show that the DTW-KNN algorithm can evaluate the rehabilitation actions, the accuracy rates of the classification in excellent, good, and normal are 85.7%, 66.7%, and 80% respectively. The intelligence system presented in this paper can help stroke survivors to proceed rehabilitation training independently and remotely, which reduces medical costs and psychological burden.https://ieeexplore.ieee.org/document/9343271/Machine learningmulti-modal sensorInternet-of-Thingsupper limb rehabilitationintelligent system
collection DOAJ
language English
format Article
sources DOAJ
author Sheng Miao
Chen Shen
Xiaochen Feng
Qixiu Zhu
Mohammad Shorfuzzaman
Zhihan Lv
spellingShingle Sheng Miao
Chen Shen
Xiaochen Feng
Qixiu Zhu
Mohammad Shorfuzzaman
Zhihan Lv
Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine Learning
IEEE Access
Machine learning
multi-modal sensor
Internet-of-Things
upper limb rehabilitation
intelligent system
author_facet Sheng Miao
Chen Shen
Xiaochen Feng
Qixiu Zhu
Mohammad Shorfuzzaman
Zhihan Lv
author_sort Sheng Miao
title Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine Learning
title_short Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine Learning
title_full Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine Learning
title_fullStr Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine Learning
title_full_unstemmed Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine Learning
title_sort upper limb rehabilitation system for stroke survivors based on multi-modal sensors and machine learning
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description Nowadays, rehabilitation training for stroke survivors is mainly completed under the guidance of the physician. There are various treatment ways, however, most of them are affected by various factors such as experience of physician and training intensity. The treatment effect cannot be fed back in time, and objective evaluation data is lacking. In addition, the treatment method is complicated, costly, and highly dependent on physicians. Moreover, stroke survivors' compliance is poor, which leads to various limitations. This paper combines the Internet-of-Things, machine learning, and intelligence system technologies to design a smartphone-based intelligence system to help stroke survivors to improve upper limb rehabilitation. With the built-in multi-modal sensors of the smart phone, training action data of users can be obtained, and then transfer to the server through the Internet. This research presents a DTW-KNN joint algorithm to recognize accuracy of rehabilitation actions and classify to multiple training completion levels. The experimental results show that the DTW-KNN algorithm can evaluate the rehabilitation actions, the accuracy rates of the classification in excellent, good, and normal are 85.7%, 66.7%, and 80% respectively. The intelligence system presented in this paper can help stroke survivors to proceed rehabilitation training independently and remotely, which reduces medical costs and psychological burden.
topic Machine learning
multi-modal sensor
Internet-of-Things
upper limb rehabilitation
intelligent system
url https://ieeexplore.ieee.org/document/9343271/
work_keys_str_mv AT shengmiao upperlimbrehabilitationsystemforstrokesurvivorsbasedonmultimodalsensorsandmachinelearning
AT chenshen upperlimbrehabilitationsystemforstrokesurvivorsbasedonmultimodalsensorsandmachinelearning
AT xiaochenfeng upperlimbrehabilitationsystemforstrokesurvivorsbasedonmultimodalsensorsandmachinelearning
AT qixiuzhu upperlimbrehabilitationsystemforstrokesurvivorsbasedonmultimodalsensorsandmachinelearning
AT mohammadshorfuzzaman upperlimbrehabilitationsystemforstrokesurvivorsbasedonmultimodalsensorsandmachinelearning
AT zhihanlv upperlimbrehabilitationsystemforstrokesurvivorsbasedonmultimodalsensorsandmachinelearning
_version_ 1724180105862840320