Human Detection System by Fusing Depth Map-Based Method and Convolutional Neural Network-Based Method

In this paper, the depth images and the colour images provided by Kinect sensors are used to enhance the accuracy of human detection. The depth-based human detection method is fast but less accurate. On the other hand, the faster region convolutional neural network-based human detection method is ac...

Full description

Bibliographic Details
Main Authors: Anh Vu Le, Tran Tin Phu, Jong Suk Choi, Jan Skapa, Miroslav Voznak
Format: Article
Language:English
Published: VSB-Technical University of Ostrava 2017-01-01
Series:Advances in Electrical and Electronic Engineering
Subjects:
Online Access:http://advances.utc.sk/index.php/AEEE/article/view/2377
id doaj-0b6b7219d1414663a37a660201fabebe
record_format Article
spelling doaj-0b6b7219d1414663a37a660201fabebe2021-10-11T08:03:07ZengVSB-Technical University of OstravaAdvances in Electrical and Electronic Engineering1336-13761804-31192017-01-0115464865610.15598/aeee.v15i4.2377939Human Detection System by Fusing Depth Map-Based Method and Convolutional Neural Network-Based MethodAnh Vu Le0Tran Tin Phu1Jong Suk Choi2Jan Skapa3Miroslav Voznak4Optoelectronics Research Group, Faculty of Electrical and Electronics Engineering, Ton Duc Thang University, No.19 Nguyen Huu Tho street, Tan Phong ward, District 7, Ho Chi Minh City, VietnamWireless Communications Research Group, Ton Duc Thang University, No. 19 Nguyen Huu Tho street, Tan Phong ward, District 7, Ho Chi Minh City, Vietnam & Faculty of Electrical and Electronics Engineering, No. 19 Nguyen Huu Tho street, Tan Phong ward, District 7, Ho Chi Minh City, VietnamCenter for Robotics Research, Korea Institute of Science and Technology, Hawolgok-dong 39-1, Seongbuk-ku, Seoul 136-79, Republic of KoreaDepartment of Telecommunications, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, 17. listopadu 15, 708 00 Ostrava, Czech RepublicDepartment of Telecommunications, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, 17. listopadu 15, 708 00 Ostrava, Czech RepublicIn this paper, the depth images and the colour images provided by Kinect sensors are used to enhance the accuracy of human detection. The depth-based human detection method is fast but less accurate. On the other hand, the faster region convolutional neural network-based human detection method is accurate but requires a rather complex hardware configuration. To simultaneously leverage the advantages and relieve the drawbacks of each method, one master and one client system is proposed. The final goal is to make a novel Robot Operation System (ROS)-based Perception Sensor Network (PSN) system, which is more accurate and ready for the real time application. The experimental results demonstrate the outperforming of the proposed method compared with other conventional methods in the challenging scenarios.http://advances.utc.sk/index.php/AEEE/article/view/2377human detection, deep learning, fusion, ros.
collection DOAJ
language English
format Article
sources DOAJ
author Anh Vu Le
Tran Tin Phu
Jong Suk Choi
Jan Skapa
Miroslav Voznak
spellingShingle Anh Vu Le
Tran Tin Phu
Jong Suk Choi
Jan Skapa
Miroslav Voznak
Human Detection System by Fusing Depth Map-Based Method and Convolutional Neural Network-Based Method
Advances in Electrical and Electronic Engineering
human detection, deep learning, fusion, ros.
author_facet Anh Vu Le
Tran Tin Phu
Jong Suk Choi
Jan Skapa
Miroslav Voznak
author_sort Anh Vu Le
title Human Detection System by Fusing Depth Map-Based Method and Convolutional Neural Network-Based Method
title_short Human Detection System by Fusing Depth Map-Based Method and Convolutional Neural Network-Based Method
title_full Human Detection System by Fusing Depth Map-Based Method and Convolutional Neural Network-Based Method
title_fullStr Human Detection System by Fusing Depth Map-Based Method and Convolutional Neural Network-Based Method
title_full_unstemmed Human Detection System by Fusing Depth Map-Based Method and Convolutional Neural Network-Based Method
title_sort human detection system by fusing depth map-based method and convolutional neural network-based method
publisher VSB-Technical University of Ostrava
series Advances in Electrical and Electronic Engineering
issn 1336-1376
1804-3119
publishDate 2017-01-01
description In this paper, the depth images and the colour images provided by Kinect sensors are used to enhance the accuracy of human detection. The depth-based human detection method is fast but less accurate. On the other hand, the faster region convolutional neural network-based human detection method is accurate but requires a rather complex hardware configuration. To simultaneously leverage the advantages and relieve the drawbacks of each method, one master and one client system is proposed. The final goal is to make a novel Robot Operation System (ROS)-based Perception Sensor Network (PSN) system, which is more accurate and ready for the real time application. The experimental results demonstrate the outperforming of the proposed method compared with other conventional methods in the challenging scenarios.
topic human detection, deep learning, fusion, ros.
url http://advances.utc.sk/index.php/AEEE/article/view/2377
work_keys_str_mv AT anhvule humandetectionsystembyfusingdepthmapbasedmethodandconvolutionalneuralnetworkbasedmethod
AT trantinphu humandetectionsystembyfusingdepthmapbasedmethodandconvolutionalneuralnetworkbasedmethod
AT jongsukchoi humandetectionsystembyfusingdepthmapbasedmethodandconvolutionalneuralnetworkbasedmethod
AT janskapa humandetectionsystembyfusingdepthmapbasedmethodandconvolutionalneuralnetworkbasedmethod
AT miroslavvoznak humandetectionsystembyfusingdepthmapbasedmethodandconvolutionalneuralnetworkbasedmethod
_version_ 1716827996638150656