A Real-Time Multilevel Fusion Recognition System for Coal and Gangue Based on Near-Infrared Sensing

Coal is an indispensable energy source for humans. As an important part of the mining industry, intelligent separation of coal and gangue will promote development. The traditional methods of recognition do not consider the interference created by a dynamic environment. There are many problems such a...

Full description

Bibliographic Details
Main Authors: Zihao Ding, Guodong Chen, Zheng Wang, Wenzheng Chi, Zhenhua Wang, Yulin Fan
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9204614/
id doaj-f9ee822d0ce441b0bfd3cf62e9fc6478
record_format Article
spelling doaj-f9ee822d0ce441b0bfd3cf62e9fc64782021-03-30T04:49:31ZengIEEEIEEE Access2169-35362020-01-01817872217873210.1109/ACCESS.2020.30261759204614A Real-Time Multilevel Fusion Recognition System for Coal and Gangue Based on Near-Infrared SensingZihao Ding0https://orcid.org/0000-0003-3477-025XGuodong Chen1https://orcid.org/0000-0002-4835-708XZheng Wang2https://orcid.org/0000-0002-9069-6210Wenzheng Chi3https://orcid.org/0000-0002-8121-2624Zhenhua Wang4https://orcid.org/0000-0002-5241-5828Yulin Fan5https://orcid.org/0000-0002-0790-5684Jiangsu Provincial Key Laboratory of Advanced Robotics, School of Mechanical and Electrical Engineering, Soochow University, Suzhou, ChinaJiangsu Provincial Key Laboratory of Advanced Robotics, School of Mechanical and Electrical Engineering, Soochow University, Suzhou, ChinaJiangsu Provincial Key Laboratory of Advanced Robotics, School of Mechanical and Electrical Engineering, Soochow University, Suzhou, ChinaJiangsu Provincial Key Laboratory of Advanced Robotics, School of Mechanical and Electrical Engineering, Soochow University, Suzhou, ChinaJiangsu Provincial Key Laboratory of Advanced Robotics, School of Mechanical and Electrical Engineering, Soochow University, Suzhou, ChinaJiangsu Provincial Key Laboratory of Advanced Robotics, School of Mechanical and Electrical Engineering, Soochow University, Suzhou, ChinaCoal is an indispensable energy source for humans. As an important part of the mining industry, intelligent separation of coal and gangue will promote development. The traditional methods of recognition do not consider the interference created by a dynamic environment. There are many problems such as noise, complex backgrounds and occlusion, which lead to low accuracy and cannot satisfy real-time requirements in mining. Aiming at dynamic environments, a real-time multilevel fusion recognition system was built in this paper. First, we introduced a near-infrared camera into the field of separation, which was used to form a binocular system with a visible light camera. The SVM classifier was obtained by feature selection and fusion training of the binocular system, which overcomes the interference of environmental factors. Then, we proposed a new deep learning training method of two-sample fusion to improve the recognition network performance by expanding the number of samples and features. Finally, the SVM and deep learning algorithms were combined to establish a fast detection strategy. In addition, the length suppression algorithm was added to solve the occlusion problem. The accuracy of the fusion algorithm was 0.923 and the detection speed was increased to 26 fps. The experimental results indicated that the sorting system satisfied the requirements of real-time and robust of the coal industry.https://ieeexplore.ieee.org/document/9204614/Coalnear-infraredsensing and fusionseparationdeep learning
collection DOAJ
language English
format Article
sources DOAJ
author Zihao Ding
Guodong Chen
Zheng Wang
Wenzheng Chi
Zhenhua Wang
Yulin Fan
spellingShingle Zihao Ding
Guodong Chen
Zheng Wang
Wenzheng Chi
Zhenhua Wang
Yulin Fan
A Real-Time Multilevel Fusion Recognition System for Coal and Gangue Based on Near-Infrared Sensing
IEEE Access
Coal
near-infrared
sensing and fusion
separation
deep learning
author_facet Zihao Ding
Guodong Chen
Zheng Wang
Wenzheng Chi
Zhenhua Wang
Yulin Fan
author_sort Zihao Ding
title A Real-Time Multilevel Fusion Recognition System for Coal and Gangue Based on Near-Infrared Sensing
title_short A Real-Time Multilevel Fusion Recognition System for Coal and Gangue Based on Near-Infrared Sensing
title_full A Real-Time Multilevel Fusion Recognition System for Coal and Gangue Based on Near-Infrared Sensing
title_fullStr A Real-Time Multilevel Fusion Recognition System for Coal and Gangue Based on Near-Infrared Sensing
title_full_unstemmed A Real-Time Multilevel Fusion Recognition System for Coal and Gangue Based on Near-Infrared Sensing
title_sort real-time multilevel fusion recognition system for coal and gangue based on near-infrared sensing
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Coal is an indispensable energy source for humans. As an important part of the mining industry, intelligent separation of coal and gangue will promote development. The traditional methods of recognition do not consider the interference created by a dynamic environment. There are many problems such as noise, complex backgrounds and occlusion, which lead to low accuracy and cannot satisfy real-time requirements in mining. Aiming at dynamic environments, a real-time multilevel fusion recognition system was built in this paper. First, we introduced a near-infrared camera into the field of separation, which was used to form a binocular system with a visible light camera. The SVM classifier was obtained by feature selection and fusion training of the binocular system, which overcomes the interference of environmental factors. Then, we proposed a new deep learning training method of two-sample fusion to improve the recognition network performance by expanding the number of samples and features. Finally, the SVM and deep learning algorithms were combined to establish a fast detection strategy. In addition, the length suppression algorithm was added to solve the occlusion problem. The accuracy of the fusion algorithm was 0.923 and the detection speed was increased to 26 fps. The experimental results indicated that the sorting system satisfied the requirements of real-time and robust of the coal industry.
topic Coal
near-infrared
sensing and fusion
separation
deep learning
url https://ieeexplore.ieee.org/document/9204614/
work_keys_str_mv AT zihaoding arealtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT guodongchen arealtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT zhengwang arealtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT wenzhengchi arealtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT zhenhuawang arealtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT yulinfan arealtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT zihaoding realtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT guodongchen realtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT zhengwang realtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT wenzhengchi realtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT zhenhuawang realtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
AT yulinfan realtimemultilevelfusionrecognitionsystemforcoalandganguebasedonnearinfraredsensing
_version_ 1724181170592153600