Underwater Image Processing and Object Detection Based on Deep CNN Method
Due to the importance of underwater exploration in the development and utilization of deep-sea resources, underwater autonomous operation is more and more important to avoid the dangerous high-pressure deep-sea environment. For underwater autonomous operation, the intelligent computer vision is the...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi Limited
2020-01-01
|
Series: | Journal of Sensors |
Online Access: | http://dx.doi.org/10.1155/2020/6707328 |
id |
doaj-d5d09f7d16ee423b88b0968e2726305a |
---|---|
record_format |
Article |
spelling |
doaj-d5d09f7d16ee423b88b0968e2726305a2020-11-25T03:26:26ZengHindawi LimitedJournal of Sensors1687-725X1687-72682020-01-01202010.1155/2020/67073286707328Underwater Image Processing and Object Detection Based on Deep CNN MethodFenglei Han0Jingzheng Yao1Haitao Zhu2Chunhui Wang3College of Shipbuilding Engineering, Harbin Engineering University, No. 145 Nantong Street, NanGang District, Harbin, Heilongjiang Province 150001, ChinaCollege of Shipbuilding Engineering, Harbin Engineering University, No. 145 Nantong Street, NanGang District, Harbin, Heilongjiang Province 150001, ChinaCollege of Shipbuilding Engineering, Harbin Engineering University, No. 145 Nantong Street, NanGang District, Harbin, Heilongjiang Province 150001, ChinaCollege of Shipbuilding Engineering, Harbin Engineering University, No. 145 Nantong Street, NanGang District, Harbin, Heilongjiang Province 150001, ChinaDue to the importance of underwater exploration in the development and utilization of deep-sea resources, underwater autonomous operation is more and more important to avoid the dangerous high-pressure deep-sea environment. For underwater autonomous operation, the intelligent computer vision is the most important technology. In an underwater environment, weak illumination and low-quality image enhancement, as a preprocessing procedure, is necessary for underwater vision. In this paper, a combination of max-RGB method and shades of gray method is applied to achieve the enhancement of underwater vision, and then a CNN (Convolutional Neutral Network) method for solving the weakly illuminated problem for underwater images is proposed to train the mapping relationship to obtain the illumination map. After the image processing, a deep CNN method is proposed to perform the underwater detection and classification, according to the characteristics of underwater vision, two improved schemes are applied to modify the deep CNN structure. In the first scheme, a 1∗1 convolution kernel is used on the 26∗26 feature map, and then a downsampling layer is added to resize the output to equal 13∗13. In the second scheme, a downsampling layer is added firstly, and then the convolution layer is inserted in the network, the result is combined with the last output to achieve the detection. Through comparison with the Fast RCNN, Faster RCNN, and the original YOLO V3, scheme 2 is verified to be better in detecting underwater objects. The detection speed is about 50 FPS (Frames per Second), and mAP (mean Average Precision) is about 90%. The program is applied in an underwater robot; the real-time detection results show that the detection and classification are accurate and fast enough to assist the robot to achieve underwater working operation.http://dx.doi.org/10.1155/2020/6707328 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Fenglei Han Jingzheng Yao Haitao Zhu Chunhui Wang |
spellingShingle |
Fenglei Han Jingzheng Yao Haitao Zhu Chunhui Wang Underwater Image Processing and Object Detection Based on Deep CNN Method Journal of Sensors |
author_facet |
Fenglei Han Jingzheng Yao Haitao Zhu Chunhui Wang |
author_sort |
Fenglei Han |
title |
Underwater Image Processing and Object Detection Based on Deep CNN Method |
title_short |
Underwater Image Processing and Object Detection Based on Deep CNN Method |
title_full |
Underwater Image Processing and Object Detection Based on Deep CNN Method |
title_fullStr |
Underwater Image Processing and Object Detection Based on Deep CNN Method |
title_full_unstemmed |
Underwater Image Processing and Object Detection Based on Deep CNN Method |
title_sort |
underwater image processing and object detection based on deep cnn method |
publisher |
Hindawi Limited |
series |
Journal of Sensors |
issn |
1687-725X 1687-7268 |
publishDate |
2020-01-01 |
description |
Due to the importance of underwater exploration in the development and utilization of deep-sea resources, underwater autonomous operation is more and more important to avoid the dangerous high-pressure deep-sea environment. For underwater autonomous operation, the intelligent computer vision is the most important technology. In an underwater environment, weak illumination and low-quality image enhancement, as a preprocessing procedure, is necessary for underwater vision. In this paper, a combination of max-RGB method and shades of gray method is applied to achieve the enhancement of underwater vision, and then a CNN (Convolutional Neutral Network) method for solving the weakly illuminated problem for underwater images is proposed to train the mapping relationship to obtain the illumination map. After the image processing, a deep CNN method is proposed to perform the underwater detection and classification, according to the characteristics of underwater vision, two improved schemes are applied to modify the deep CNN structure. In the first scheme, a 1∗1 convolution kernel is used on the 26∗26 feature map, and then a downsampling layer is added to resize the output to equal 13∗13. In the second scheme, a downsampling layer is added firstly, and then the convolution layer is inserted in the network, the result is combined with the last output to achieve the detection. Through comparison with the Fast RCNN, Faster RCNN, and the original YOLO V3, scheme 2 is verified to be better in detecting underwater objects. The detection speed is about 50 FPS (Frames per Second), and mAP (mean Average Precision) is about 90%. The program is applied in an underwater robot; the real-time detection results show that the detection and classification are accurate and fast enough to assist the robot to achieve underwater working operation. |
url |
http://dx.doi.org/10.1155/2020/6707328 |
work_keys_str_mv |
AT fengleihan underwaterimageprocessingandobjectdetectionbasedondeepcnnmethod AT jingzhengyao underwaterimageprocessingandobjectdetectionbasedondeepcnnmethod AT haitaozhu underwaterimageprocessingandobjectdetectionbasedondeepcnnmethod AT chunhuiwang underwaterimageprocessingandobjectdetectionbasedondeepcnnmethod |
_version_ |
1715214925514670080 |