Adaptive Multi-Task Human-Robot Interaction Based on Human Behavioral Intention

Learning from demonstrations with Probabilistic Movement Primitives (ProMPs) has been widely used in robot skill learning, especially in human-robot collaboration. Although ProMP has been extended to multi-task situations inspired by the Gaussian mixture model, it still treats each task independentl...

Full description

Bibliographic Details
Main Authors: Jian Fu, Jinyu Du, Xiang Teng, Yuxiang Fu, Lu Wu
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9548924/
id doaj-b4ad31e252cd46e8afb2d42b26197a5a
record_format Article
spelling doaj-b4ad31e252cd46e8afb2d42b26197a5a2021-10-04T23:00:38ZengIEEEIEEE Access2169-35362021-01-01913376213377310.1109/ACCESS.2021.31157569548924Adaptive Multi-Task Human-Robot Interaction Based on Human Behavioral IntentionJian Fu0https://orcid.org/0000-0001-7044-5302Jinyu Du1Xiang Teng2Yuxiang Fu3Lu Wu4School of Automation, Wuhan University of Technology, Wuhan, ChinaSchool of Automation, Wuhan University of Technology, Wuhan, ChinaSchool of Automation, Wuhan University of Technology, Wuhan, ChinaDepartment of Computer Science, The University of British Columbia, Vancouver, BC, CanadaSchool of Information, Wuhan University of Technology, Wuhan, ChinaLearning from demonstrations with Probabilistic Movement Primitives (ProMPs) has been widely used in robot skill learning, especially in human-robot collaboration. Although ProMP has been extended to multi-task situations inspired by the Gaussian mixture model, it still treats each task independently. ProMP ignores the common scenario that robots conduct adaptive switching of the collaborative tasks in order to align with the instantaneous change of human intention. To solve this problem, we proposed an alternate learning-based parameter estimation method and an empirical minimum variation-based decomposition strategy with projection points, combining with linear interpolation strategy for weights, based on a Gaussian mixture model framework. Alternate learning of weights and parameters in multi-task ProMP (MTProMP) allows the robot to obtain a smooth composite trajectory planning which crosses expected via points. Decomposition strategy reflects how the desired via point state is projected onto the individual ProMP component, rendering the minimum total sum of deviations between each projection point with the respective prior. Linear interpolation is used to adjust the weights among sequential via points automatically. The proposed method and strategy are successfully extended to multi-task interaction ProMPs (MTiProMP). With MTProMP and MTiProMP, the robot can be applied to multiple tasks in industrial factories and collaborate with the worker to switch from one task to another according to changing intentions of the human. Classical via points trajectory planning experiments and human-robot collaboration experiments are performed on the Sawyer robot. The results of experiments show that MTProMP and MTiProMP with the proposed method and strategy perform better.https://ieeexplore.ieee.org/document/9548924/Human robot interactionmotion planningMTProMPMTiProMPalternate learningdecomposition strategy
collection DOAJ
language English
format Article
sources DOAJ
author Jian Fu
Jinyu Du
Xiang Teng
Yuxiang Fu
Lu Wu
spellingShingle Jian Fu
Jinyu Du
Xiang Teng
Yuxiang Fu
Lu Wu
Adaptive Multi-Task Human-Robot Interaction Based on Human Behavioral Intention
IEEE Access
Human robot interaction
motion planning
MTProMP
MTiProMP
alternate learning
decomposition strategy
author_facet Jian Fu
Jinyu Du
Xiang Teng
Yuxiang Fu
Lu Wu
author_sort Jian Fu
title Adaptive Multi-Task Human-Robot Interaction Based on Human Behavioral Intention
title_short Adaptive Multi-Task Human-Robot Interaction Based on Human Behavioral Intention
title_full Adaptive Multi-Task Human-Robot Interaction Based on Human Behavioral Intention
title_fullStr Adaptive Multi-Task Human-Robot Interaction Based on Human Behavioral Intention
title_full_unstemmed Adaptive Multi-Task Human-Robot Interaction Based on Human Behavioral Intention
title_sort adaptive multi-task human-robot interaction based on human behavioral intention
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description Learning from demonstrations with Probabilistic Movement Primitives (ProMPs) has been widely used in robot skill learning, especially in human-robot collaboration. Although ProMP has been extended to multi-task situations inspired by the Gaussian mixture model, it still treats each task independently. ProMP ignores the common scenario that robots conduct adaptive switching of the collaborative tasks in order to align with the instantaneous change of human intention. To solve this problem, we proposed an alternate learning-based parameter estimation method and an empirical minimum variation-based decomposition strategy with projection points, combining with linear interpolation strategy for weights, based on a Gaussian mixture model framework. Alternate learning of weights and parameters in multi-task ProMP (MTProMP) allows the robot to obtain a smooth composite trajectory planning which crosses expected via points. Decomposition strategy reflects how the desired via point state is projected onto the individual ProMP component, rendering the minimum total sum of deviations between each projection point with the respective prior. Linear interpolation is used to adjust the weights among sequential via points automatically. The proposed method and strategy are successfully extended to multi-task interaction ProMPs (MTiProMP). With MTProMP and MTiProMP, the robot can be applied to multiple tasks in industrial factories and collaborate with the worker to switch from one task to another according to changing intentions of the human. Classical via points trajectory planning experiments and human-robot collaboration experiments are performed on the Sawyer robot. The results of experiments show that MTProMP and MTiProMP with the proposed method and strategy perform better.
topic Human robot interaction
motion planning
MTProMP
MTiProMP
alternate learning
decomposition strategy
url https://ieeexplore.ieee.org/document/9548924/
work_keys_str_mv AT jianfu adaptivemultitaskhumanrobotinteractionbasedonhumanbehavioralintention
AT jinyudu adaptivemultitaskhumanrobotinteractionbasedonhumanbehavioralintention
AT xiangteng adaptivemultitaskhumanrobotinteractionbasedonhumanbehavioralintention
AT yuxiangfu adaptivemultitaskhumanrobotinteractionbasedonhumanbehavioralintention
AT luwu adaptivemultitaskhumanrobotinteractionbasedonhumanbehavioralintention
_version_ 1716843844835737600