A musculoskeletal model of the human hand to improve human-device interaction

abstract: Multi-touch tablets and smart phones are now widely used in both workplace and consumer settings. Interacting with these devices requires hand and arm movements that are potentially complex and poorly understood. Experimental studies have revealed differences in performance that could pote...

Full description

Bibliographic Details
Other Authors: Lee, Jong Hwa (Author)
Format: Doctoral Thesis
Language:English
Published: 2014
Subjects:
Online Access:http://hdl.handle.net/2286/R.I.25923
id ndltd-asu.edu-item-25923
record_format oai_dc
spelling ndltd-asu.edu-item-259232018-06-22T03:05:26Z A musculoskeletal model of the human hand to improve human-device interaction abstract: Multi-touch tablets and smart phones are now widely used in both workplace and consumer settings. Interacting with these devices requires hand and arm movements that are potentially complex and poorly understood. Experimental studies have revealed differences in performance that could potentially be associated with injury risk. However, underlying causes for performance differences are often difficult to identify. For example, many patterns of muscle activity can potentially result in similar behavioral output. Muscle activity is one factor contributing to forces in tissues that could contribute to injury. However, experimental measurements of muscle activity and force for humans are extremely challenging. Models of the musculoskeletal system can be used to make specific estimates of neuromuscular coordination and musculoskeletal forces. However, existing models cannot easily be used to describe complex, multi-finger gestures such as those used for multi-touch human computer interaction (HCI) tasks. We therefore seek to develop a dynamic musculoskeletal simulation capable of estimating internal musculoskeletal loading during multi-touch tasks involving multi digits of the hand, and use the simulation to better understand complex multi-touch and gestural movements, and potentially guide the design of technologies the reduce injury risk. To accomplish these, we focused on three specific tasks. First, we aimed at determining the optimal index finger muscle attachment points within the context of the established, validated OpenSim arm model using measured moment arm data taken from the literature. Second, we aimed at deriving moment arm values from experimentally-measured muscle attachments and using these values to determine muscle-tendon paths for both extrinsic and intrinsic muscles of middle, ring and little fingers. Finally, we aimed at exploring differences in hand muscle activation patterns during zooming and rotating tasks on the tablet computer in twelve subjects. Towards this end, our musculoskeletal hand model will help better address the neuromuscular coordination, safe gesture performance and internal loadings for multi-touch applications. Dissertation/Thesis Lee, Jong Hwa (Author) Jindrich, Devin L. (Advisor) Artemiadis, Panagiotis K. (Advisor) Phelan, Patrick (Committee member) Santos, Veronica J. (Committee member) Huang, Huei-Ping (Committee member) Arizona State University (Publisher) Biomechanics Mechanical engineering Biomedical engineering biomechanics hand moment arm multi-touch muscle geometry musculoskeletal eng 123 pages Doctoral Dissertation Mechanical Engineering 2014 Doctoral Dissertation http://hdl.handle.net/2286/R.I.25923 http://rightsstatements.org/vocab/InC/1.0/ All Rights Reserved 2014
collection NDLTD
language English
format Doctoral Thesis
sources NDLTD
topic Biomechanics
Mechanical engineering
Biomedical engineering
biomechanics
hand
moment arm
multi-touch
muscle geometry
musculoskeletal
spellingShingle Biomechanics
Mechanical engineering
Biomedical engineering
biomechanics
hand
moment arm
multi-touch
muscle geometry
musculoskeletal
A musculoskeletal model of the human hand to improve human-device interaction
description abstract: Multi-touch tablets and smart phones are now widely used in both workplace and consumer settings. Interacting with these devices requires hand and arm movements that are potentially complex and poorly understood. Experimental studies have revealed differences in performance that could potentially be associated with injury risk. However, underlying causes for performance differences are often difficult to identify. For example, many patterns of muscle activity can potentially result in similar behavioral output. Muscle activity is one factor contributing to forces in tissues that could contribute to injury. However, experimental measurements of muscle activity and force for humans are extremely challenging. Models of the musculoskeletal system can be used to make specific estimates of neuromuscular coordination and musculoskeletal forces. However, existing models cannot easily be used to describe complex, multi-finger gestures such as those used for multi-touch human computer interaction (HCI) tasks. We therefore seek to develop a dynamic musculoskeletal simulation capable of estimating internal musculoskeletal loading during multi-touch tasks involving multi digits of the hand, and use the simulation to better understand complex multi-touch and gestural movements, and potentially guide the design of technologies the reduce injury risk. To accomplish these, we focused on three specific tasks. First, we aimed at determining the optimal index finger muscle attachment points within the context of the established, validated OpenSim arm model using measured moment arm data taken from the literature. Second, we aimed at deriving moment arm values from experimentally-measured muscle attachments and using these values to determine muscle-tendon paths for both extrinsic and intrinsic muscles of middle, ring and little fingers. Finally, we aimed at exploring differences in hand muscle activation patterns during zooming and rotating tasks on the tablet computer in twelve subjects. Towards this end, our musculoskeletal hand model will help better address the neuromuscular coordination, safe gesture performance and internal loadings for multi-touch applications. === Dissertation/Thesis === Doctoral Dissertation Mechanical Engineering 2014
author2 Lee, Jong Hwa (Author)
author_facet Lee, Jong Hwa (Author)
title A musculoskeletal model of the human hand to improve human-device interaction
title_short A musculoskeletal model of the human hand to improve human-device interaction
title_full A musculoskeletal model of the human hand to improve human-device interaction
title_fullStr A musculoskeletal model of the human hand to improve human-device interaction
title_full_unstemmed A musculoskeletal model of the human hand to improve human-device interaction
title_sort musculoskeletal model of the human hand to improve human-device interaction
publishDate 2014
url http://hdl.handle.net/2286/R.I.25923
_version_ 1718700519502905344