Drill Fault Diagnosis Based on the Scalogram and Mel Spectrogram of Sound Signals Using Artificial Intelligence

In industry, the ability to detect damage or abnormal functioning in machinery is very important. However, manual detection of machine fault sound is economically inefficient and labor-intensive. Hence, automatic machine fault detection (MFD) plays an important role in reducing operating and personn...

Full description

Bibliographic Details
Main Authors: Thanh Tran, Jan Lundgren
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9252126/
id doaj-b7c71e59e94e4ebba7b7778734abf84d
record_format Article
spelling doaj-b7c71e59e94e4ebba7b7778734abf84d2021-03-30T04:34:14ZengIEEEIEEE Access2169-35362020-01-01820365520366610.1109/ACCESS.2020.30367699252126Drill Fault Diagnosis Based on the Scalogram and Mel Spectrogram of Sound Signals Using Artificial IntelligenceThanh Tran0https://orcid.org/0000-0002-8262-2414Jan Lundgren1Department of Electronics Design, Mid Sweden University, Sundsvall, SwedenDepartment of Electronics Design, Mid Sweden University, Sundsvall, SwedenIn industry, the ability to detect damage or abnormal functioning in machinery is very important. However, manual detection of machine fault sound is economically inefficient and labor-intensive. Hence, automatic machine fault detection (MFD) plays an important role in reducing operating and personnel costs compared to manual machine fault detection. This research aims to develop a drill fault detection system using state-of-the-art artificial intelligence techniques. Many researchers have applied the traditional approach design for an MFD system, including handcrafted feature extraction of the raw sound signal, feature selection, and conventional classification. However, drill sound fault detection based on conventional machine learning methods using the raw sound signal in the time domain faces a number of challenges. For example, it can be difficult to extract and select good features to input in a classifier, and the accuracy of fault detection may not be sufficient to meet industrial requirements. Hence, we propose a method that uses deep learning architecture to extract rich features from the image representation of sound signals combined with machine learning classifiers to classify drill fault sounds of drilling machines. The proposed methods are trained and evaluated using the real sound dataset provided by the factory. The experiment results show a good classification accuracy of 80.25 percent when using Mel spectrogram and scalogram images. The results promise significant potential for using in the fault diagnosis support system based on the sounds of drilling machines.https://ieeexplore.ieee.org/document/9252126/Deep learningmachine fault diagnosismachine learningsound signal processing
collection DOAJ
language English
format Article
sources DOAJ
author Thanh Tran
Jan Lundgren
spellingShingle Thanh Tran
Jan Lundgren
Drill Fault Diagnosis Based on the Scalogram and Mel Spectrogram of Sound Signals Using Artificial Intelligence
IEEE Access
Deep learning
machine fault diagnosis
machine learning
sound signal processing
author_facet Thanh Tran
Jan Lundgren
author_sort Thanh Tran
title Drill Fault Diagnosis Based on the Scalogram and Mel Spectrogram of Sound Signals Using Artificial Intelligence
title_short Drill Fault Diagnosis Based on the Scalogram and Mel Spectrogram of Sound Signals Using Artificial Intelligence
title_full Drill Fault Diagnosis Based on the Scalogram and Mel Spectrogram of Sound Signals Using Artificial Intelligence
title_fullStr Drill Fault Diagnosis Based on the Scalogram and Mel Spectrogram of Sound Signals Using Artificial Intelligence
title_full_unstemmed Drill Fault Diagnosis Based on the Scalogram and Mel Spectrogram of Sound Signals Using Artificial Intelligence
title_sort drill fault diagnosis based on the scalogram and mel spectrogram of sound signals using artificial intelligence
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description In industry, the ability to detect damage or abnormal functioning in machinery is very important. However, manual detection of machine fault sound is economically inefficient and labor-intensive. Hence, automatic machine fault detection (MFD) plays an important role in reducing operating and personnel costs compared to manual machine fault detection. This research aims to develop a drill fault detection system using state-of-the-art artificial intelligence techniques. Many researchers have applied the traditional approach design for an MFD system, including handcrafted feature extraction of the raw sound signal, feature selection, and conventional classification. However, drill sound fault detection based on conventional machine learning methods using the raw sound signal in the time domain faces a number of challenges. For example, it can be difficult to extract and select good features to input in a classifier, and the accuracy of fault detection may not be sufficient to meet industrial requirements. Hence, we propose a method that uses deep learning architecture to extract rich features from the image representation of sound signals combined with machine learning classifiers to classify drill fault sounds of drilling machines. The proposed methods are trained and evaluated using the real sound dataset provided by the factory. The experiment results show a good classification accuracy of 80.25 percent when using Mel spectrogram and scalogram images. The results promise significant potential for using in the fault diagnosis support system based on the sounds of drilling machines.
topic Deep learning
machine fault diagnosis
machine learning
sound signal processing
url https://ieeexplore.ieee.org/document/9252126/
work_keys_str_mv AT thanhtran drillfaultdiagnosisbasedonthescalogramandmelspectrogramofsoundsignalsusingartificialintelligence
AT janlundgren drillfaultdiagnosisbasedonthescalogramandmelspectrogramofsoundsignalsusingartificialintelligence
_version_ 1724181580828639232