Automatic System for Visual Detection of Dirt Buildup on Conveyor Belts Using Convolutional Neural Networks

• Main Authors: André A. Santos, Filipe A. S. Rocha, Agnaldo J. da R. Reis, Frederico G. Guimarães
• Format: Article
• Language: English
• Published: MDPI AG 2020-10-01
• Series: Sensors
• Subjects: convolutional neural network; conveyor belt; machine learning
• Online Access: https://www.mdpi.com/1424-8220/20/20/5762

Conveyor belts are the most widespread means of transportation for large quantities of materials in the mining sector. Therefore, autonomous methods that can help human beings to perform the inspection of the belt conveyor system is a major concern for companies. In this context, we present in this work a novel and automatic visual detector that recognizes dirt buildup on the structures of conveyor belts, which is one of the tasks of the maintenance inspectors. This visual detector can be embedded as sensors in autonomous robots for the inspection activity. The proposed system involves training a convolutional neural network from RGB images. The use of the transfer learning technique, i.e., retraining consolidated networks for image classification with our collected images has shown very effective. Two different approaches for transfer learning have been analyzed. The best one presented an average accuracy of 0.8975 with an F-1 Score of 0.8773 for the dirt recognition. A field validation experiment served to evaluate the performance of the proposed system in a real time classification task.