Learning and Planning Based on Merged Experience from Multiple Situations for a Service Robot

For a service robot, learning appropriate behaviours to acquire task knowledge and deliberation in various situations is essential, but the existing methods do not support merging the plan-based activity experiences from multiple situations in the same task. In this paper, an abstract method is intr...

Full description

Bibliographic Details
Main Authors: Zhixian Chen, Baoliang Zhao, Shijia Zhao, Ying Hu, Jianwei Zhang
Format: Article
Language:English
Published: MDPI AG 2018-10-01
Series:Applied Sciences
Subjects:
Online Access:http://www.mdpi.com/2076-3417/8/10/1832
id doaj-2eb706021a674a33a82695f3d634c5c8
record_format Article
spelling doaj-2eb706021a674a33a82695f3d634c5c82020-11-24T23:08:34ZengMDPI AGApplied Sciences2076-34172018-10-01810183210.3390/app8101832app8101832Learning and Planning Based on Merged Experience from Multiple Situations for a Service RobotZhixian Chen0Baoliang Zhao1Shijia Zhao2Ying Hu3Jianwei Zhang4Shenzhen Key Laboratory of Minimally Invasive Surgical Robotics and System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, ChinaShenzhen Key Laboratory of Minimally Invasive Surgical Robotics and System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, ChinaShenzhen Key Laboratory of Minimally Invasive Surgical Robotics and System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, ChinaShenzhen Key Laboratory of Minimally Invasive Surgical Robotics and System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, ChinaTechnical Aspects of Multimodal Systems (TAMS), University of Hamburg, 22527 Hamburg, GermanyFor a service robot, learning appropriate behaviours to acquire task knowledge and deliberation in various situations is essential, but the existing methods do not support merging the plan-based activity experiences from multiple situations in the same task. In this paper, an abstract method is introduced to integrate the empirical activity schemas of multiple situations, and a novel algorithm is presented to learn activity schema with abstract methods. Furthermore, a novel planner called the schema-based optimized planner (SBOP) is developed based on the learned activity schema, in which actions merging optimization and partially backtracking techniques are adopted. A simulation with a PR2 robot and a physical experiment is conducted to validate the proposed method. The results show that the robot can generate a plan to recover from failure automatically using the novel learning and planning method, given that the experienced exception has been merged in the activity schema. Owing to the improved autonomy, the proposed SBOP exhibits increased efficiency in dealing with tasks containing loops and multiple activity schema instances. This research presents a novel solution of how to merge activity experiences from multiple situations and generate an intelligent and efficient plan that could adapt to a dynamically changing environment.http://www.mdpi.com/2076-3417/8/10/1832task knowledgeactivity schemaHTN planningexperiences mergingabstract method
collection DOAJ
language English
format Article
sources DOAJ
author Zhixian Chen
Baoliang Zhao
Shijia Zhao
Ying Hu
Jianwei Zhang
spellingShingle Zhixian Chen
Baoliang Zhao
Shijia Zhao
Ying Hu
Jianwei Zhang
Learning and Planning Based on Merged Experience from Multiple Situations for a Service Robot
Applied Sciences
task knowledge
activity schema
HTN planning
experiences merging
abstract method
author_facet Zhixian Chen
Baoliang Zhao
Shijia Zhao
Ying Hu
Jianwei Zhang
author_sort Zhixian Chen
title Learning and Planning Based on Merged Experience from Multiple Situations for a Service Robot
title_short Learning and Planning Based on Merged Experience from Multiple Situations for a Service Robot
title_full Learning and Planning Based on Merged Experience from Multiple Situations for a Service Robot
title_fullStr Learning and Planning Based on Merged Experience from Multiple Situations for a Service Robot
title_full_unstemmed Learning and Planning Based on Merged Experience from Multiple Situations for a Service Robot
title_sort learning and planning based on merged experience from multiple situations for a service robot
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2018-10-01
description For a service robot, learning appropriate behaviours to acquire task knowledge and deliberation in various situations is essential, but the existing methods do not support merging the plan-based activity experiences from multiple situations in the same task. In this paper, an abstract method is introduced to integrate the empirical activity schemas of multiple situations, and a novel algorithm is presented to learn activity schema with abstract methods. Furthermore, a novel planner called the schema-based optimized planner (SBOP) is developed based on the learned activity schema, in which actions merging optimization and partially backtracking techniques are adopted. A simulation with a PR2 robot and a physical experiment is conducted to validate the proposed method. The results show that the robot can generate a plan to recover from failure automatically using the novel learning and planning method, given that the experienced exception has been merged in the activity schema. Owing to the improved autonomy, the proposed SBOP exhibits increased efficiency in dealing with tasks containing loops and multiple activity schema instances. This research presents a novel solution of how to merge activity experiences from multiple situations and generate an intelligent and efficient plan that could adapt to a dynamically changing environment.
topic task knowledge
activity schema
HTN planning
experiences merging
abstract method
url http://www.mdpi.com/2076-3417/8/10/1832
work_keys_str_mv AT zhixianchen learningandplanningbasedonmergedexperiencefrommultiplesituationsforaservicerobot
AT baoliangzhao learningandplanningbasedonmergedexperiencefrommultiplesituationsforaservicerobot
AT shijiazhao learningandplanningbasedonmergedexperiencefrommultiplesituationsforaservicerobot
AT yinghu learningandplanningbasedonmergedexperiencefrommultiplesituationsforaservicerobot
AT jianweizhang learningandplanningbasedonmergedexperiencefrommultiplesituationsforaservicerobot
_version_ 1725613564749676544