A Multimodal Hydrogel Soft-Robotic Sensor for Multi-Functional Perception

Soft robots, with their unique and outstanding capabilities of environmental conformation, natural sealing against elements, as well as being insensitive to magnetic/electrical effects, are ideal candidates for extreme environment applications. However, sensing for soft robots in such harsh conditio...

Full description

Bibliographic Details
Main Authors: Yu Cheng, Runzhi Zhang, Wenpei Zhu, Hua Zhong, Sicong Liu, Juan Yi, Liyang Shao, Wenping Wang, James Lam, Zheng Wang
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-08-01
Series:Frontiers in Robotics and AI
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frobt.2021.692754/full
id doaj-129324b8d3124c95808069c71a4d9ff8
record_format Article
collection DOAJ
language English
format Article
sources DOAJ
author Yu Cheng
Yu Cheng
Yu Cheng
Yu Cheng
Runzhi Zhang
Wenpei Zhu
Wenpei Zhu
Wenpei Zhu
Hua Zhong
Sicong Liu
Sicong Liu
Sicong Liu
Juan Yi
Juan Yi
Juan Yi
Liyang Shao
Wenping Wang
James Lam
Zheng Wang
Zheng Wang
Zheng Wang
Zheng Wang
spellingShingle Yu Cheng
Yu Cheng
Yu Cheng
Yu Cheng
Runzhi Zhang
Wenpei Zhu
Wenpei Zhu
Wenpei Zhu
Hua Zhong
Sicong Liu
Sicong Liu
Sicong Liu
Juan Yi
Juan Yi
Juan Yi
Liyang Shao
Wenping Wang
James Lam
Zheng Wang
Zheng Wang
Zheng Wang
Zheng Wang
A Multimodal Hydrogel Soft-Robotic Sensor for Multi-Functional Perception
Frontiers in Robotics and AI
soft sensor
multimodal
multifunctional perception
hydrogel
electrical and optical properties
author_facet Yu Cheng
Yu Cheng
Yu Cheng
Yu Cheng
Runzhi Zhang
Wenpei Zhu
Wenpei Zhu
Wenpei Zhu
Hua Zhong
Sicong Liu
Sicong Liu
Sicong Liu
Juan Yi
Juan Yi
Juan Yi
Liyang Shao
Wenping Wang
James Lam
Zheng Wang
Zheng Wang
Zheng Wang
Zheng Wang
author_sort Yu Cheng
title A Multimodal Hydrogel Soft-Robotic Sensor for Multi-Functional Perception
title_short A Multimodal Hydrogel Soft-Robotic Sensor for Multi-Functional Perception
title_full A Multimodal Hydrogel Soft-Robotic Sensor for Multi-Functional Perception
title_fullStr A Multimodal Hydrogel Soft-Robotic Sensor for Multi-Functional Perception
title_full_unstemmed A Multimodal Hydrogel Soft-Robotic Sensor for Multi-Functional Perception
title_sort multimodal hydrogel soft-robotic sensor for multi-functional perception
publisher Frontiers Media S.A.
series Frontiers in Robotics and AI
issn 2296-9144
publishDate 2021-08-01
description Soft robots, with their unique and outstanding capabilities of environmental conformation, natural sealing against elements, as well as being insensitive to magnetic/electrical effects, are ideal candidates for extreme environment applications. However, sensing for soft robots in such harsh conditions would still be challenging, especially under large temperature change and complex, large deformations. Existing soft sensing approaches using liquid-metal medium compromise between large deformation and environmental robustness, limiting their real-world applicability. In this work, we propose a multimodal solid-state soft sensor using hydrogel and silicone. By exploiting the conductance and transparency of hydrogel, we could deploy both optical and resistive sensing in one sensing component. This novel combination enables us to benefit from the in-situ measurement discrepancies between the optical and electrical signal, to extract multifunctional measurements. Following this approach, prototype solid-state soft sensors were designed and fabricated, a dedicated neural network was built to extract the sensory information. Stretching and twisting were measured using the same sensor even at large deformations. In addition, exploiting the distinctive responses against temperature change, we could estimate environmental temperatures simultaneously. Results are promising for the proposed solid-state multimodal approach of soft sensors for multifunctional perception under extreme conditions.
topic soft sensor
multimodal
multifunctional perception
hydrogel
electrical and optical properties
url https://www.frontiersin.org/articles/10.3389/frobt.2021.692754/full
work_keys_str_mv AT yucheng amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT yucheng amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT yucheng amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT yucheng amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT runzhizhang amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT wenpeizhu amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT wenpeizhu amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT wenpeizhu amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT huazhong amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT sicongliu amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT sicongliu amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT sicongliu amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT juanyi amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT juanyi amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT juanyi amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT liyangshao amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT wenpingwang amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT jameslam amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT zhengwang amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT zhengwang amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT zhengwang amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT zhengwang amultimodalhydrogelsoftroboticsensorformultifunctionalperception
AT yucheng multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT yucheng multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT yucheng multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT yucheng multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT runzhizhang multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT wenpeizhu multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT wenpeizhu multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT wenpeizhu multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT huazhong multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT sicongliu multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT sicongliu multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT sicongliu multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT juanyi multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT juanyi multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT juanyi multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT liyangshao multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT wenpingwang multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT jameslam multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT zhengwang multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT zhengwang multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT zhengwang multimodalhydrogelsoftroboticsensorformultifunctionalperception
AT zhengwang multimodalhydrogelsoftroboticsensorformultifunctionalperception
_version_ 1721195863233003520
spelling doaj-129324b8d3124c95808069c71a4d9ff82021-08-26T09:24:37ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442021-08-01810.3389/frobt.2021.692754692754A Multimodal Hydrogel Soft-Robotic Sensor for Multi-Functional PerceptionYu Cheng0Yu Cheng1Yu Cheng2Yu Cheng3Runzhi Zhang4Wenpei Zhu5Wenpei Zhu6Wenpei Zhu7Hua Zhong8Sicong Liu9Sicong Liu10Sicong Liu11Juan Yi12Juan Yi13Juan Yi14Liyang Shao15Wenping Wang16James Lam17Zheng Wang18Zheng Wang19Zheng Wang20Zheng Wang21Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaGuangdong Provincial Key Laboratory of Human Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology, Shenzhen, ChinaDepartment of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaSchool of Innovation and Entrepreneurship, Southern University of Science and Technology, Shenzhen, ChinaDepartment of Mechanical Engineering, The University of Hong Kong, Hong Kong, ChinaShenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaGuangdong Provincial Key Laboratory of Human Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology, Shenzhen, ChinaDepartment of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaDepartment of Computer Science, The University of Hong Kong, Hong Kong, ChinaShenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaGuangdong Provincial Key Laboratory of Human Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology, Shenzhen, ChinaDepartment of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaShenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaGuangdong Provincial Key Laboratory of Human Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology, Shenzhen, ChinaDepartment of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaSchool of Innovation and Entrepreneurship, Southern University of Science and Technology, Shenzhen, ChinaDepartment of Computer Science, The University of Hong Kong, Hong Kong, ChinaDepartment of Mechanical Engineering, The University of Hong Kong, Hong Kong, ChinaShenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaGuangdong Provincial Key Laboratory of Human Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology, Shenzhen, ChinaDepartment of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, ChinaDepartment of Mechanical Engineering, The University of Hong Kong, Hong Kong, ChinaSoft robots, with their unique and outstanding capabilities of environmental conformation, natural sealing against elements, as well as being insensitive to magnetic/electrical effects, are ideal candidates for extreme environment applications. However, sensing for soft robots in such harsh conditions would still be challenging, especially under large temperature change and complex, large deformations. Existing soft sensing approaches using liquid-metal medium compromise between large deformation and environmental robustness, limiting their real-world applicability. In this work, we propose a multimodal solid-state soft sensor using hydrogel and silicone. By exploiting the conductance and transparency of hydrogel, we could deploy both optical and resistive sensing in one sensing component. This novel combination enables us to benefit from the in-situ measurement discrepancies between the optical and electrical signal, to extract multifunctional measurements. Following this approach, prototype solid-state soft sensors were designed and fabricated, a dedicated neural network was built to extract the sensory information. Stretching and twisting were measured using the same sensor even at large deformations. In addition, exploiting the distinctive responses against temperature change, we could estimate environmental temperatures simultaneously. Results are promising for the proposed solid-state multimodal approach of soft sensors for multifunctional perception under extreme conditions.https://www.frontiersin.org/articles/10.3389/frobt.2021.692754/fullsoft sensormultimodalmultifunctional perceptionhydrogelelectrical and optical properties