Effective Complex Airport Object Detection in Remote Sensing Images Based on Improved End-to-End Convolutional Neural Network

Airport objects are hotspots in the field of image object detection because of their specific features and value for applications. In this study, we developed a complex object detection method based on improved Faster R-CNN to achieve higher detection precision to detect seven types of remote sensin...

Full description

Bibliographic Details
Main Authors: Yongsai Han, Shiping Ma, Yuelei Xu, Linyuan He, Shuai Li, Mingming Zhu
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9186593/
id doaj-8a61e6447a394634b7a7038b0924defe
record_format Article
spelling doaj-8a61e6447a394634b7a7038b0924defe2021-03-30T03:58:57ZengIEEEIEEE Access2169-35362020-01-01817265217266310.1109/ACCESS.2020.30218959186593Effective Complex Airport Object Detection in Remote Sensing Images Based on Improved End-to-End Convolutional Neural NetworkYongsai Han0https://orcid.org/0000-0003-4296-7466Shiping Ma1Yuelei Xu2Linyuan He3Shuai Li4Mingming Zhu5Graduate School, Air Force Engineering University, Xi’an, ChinaAeronautics Engineering College, Air Force Engineering University, Xi’an, ChinaUnmanned Systems Technology Institute, Northwestern Polytechnical University, Xi’an, ChinaAeronautics Engineering College, Air Force Engineering University, Xi’an, ChinaGraduate School, Air Force Engineering University, Xi’an, ChinaGraduate School, Air Force Engineering University, Xi’an, ChinaAirport objects are hotspots in the field of image object detection because of their specific features and value for applications. In this study, we developed a complex object detection method based on improved Faster R-CNN to achieve higher detection precision to detect seven types of remote sensing image objects in airport areas under complex conditions such as different scales, different visual angles, and different backgrounds. When building the network, we used deeper basic networks and feature fusion components to extract more robust features. At the same time, we had also modified the selection of positive and negative samples to improve sample imbalance. The main improvements in the algorithm concern the anchor size generation rule, and the addition of an a priori judgment network for the network. The effectiveness of the improved algorithm was verified in experiments. Compared with the original Faster R-CNN, the improved network brings a 12.7% increase in mAP, at the detection time of 0.307s. Finally, the model with trained weights was used to test the detection of the seven types of objects in airport areas on different data sets, and comparisons were conducted with other algorithms. The experimental results showed that the method improved the average detection accuracy and had a good performance in remote sensing airport object detection tasks.https://ieeexplore.ieee.org/document/9186593/Airport objectimage processingmulti-class object detectionpattern recognitionremote sensing
collection DOAJ
language English
format Article
sources DOAJ
author Yongsai Han
Shiping Ma
Yuelei Xu
Linyuan He
Shuai Li
Mingming Zhu
spellingShingle Yongsai Han
Shiping Ma
Yuelei Xu
Linyuan He
Shuai Li
Mingming Zhu
Effective Complex Airport Object Detection in Remote Sensing Images Based on Improved End-to-End Convolutional Neural Network
IEEE Access
Airport object
image processing
multi-class object detection
pattern recognition
remote sensing
author_facet Yongsai Han
Shiping Ma
Yuelei Xu
Linyuan He
Shuai Li
Mingming Zhu
author_sort Yongsai Han
title Effective Complex Airport Object Detection in Remote Sensing Images Based on Improved End-to-End Convolutional Neural Network
title_short Effective Complex Airport Object Detection in Remote Sensing Images Based on Improved End-to-End Convolutional Neural Network
title_full Effective Complex Airport Object Detection in Remote Sensing Images Based on Improved End-to-End Convolutional Neural Network
title_fullStr Effective Complex Airport Object Detection in Remote Sensing Images Based on Improved End-to-End Convolutional Neural Network
title_full_unstemmed Effective Complex Airport Object Detection in Remote Sensing Images Based on Improved End-to-End Convolutional Neural Network
title_sort effective complex airport object detection in remote sensing images based on improved end-to-end convolutional neural network
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Airport objects are hotspots in the field of image object detection because of their specific features and value for applications. In this study, we developed a complex object detection method based on improved Faster R-CNN to achieve higher detection precision to detect seven types of remote sensing image objects in airport areas under complex conditions such as different scales, different visual angles, and different backgrounds. When building the network, we used deeper basic networks and feature fusion components to extract more robust features. At the same time, we had also modified the selection of positive and negative samples to improve sample imbalance. The main improvements in the algorithm concern the anchor size generation rule, and the addition of an a priori judgment network for the network. The effectiveness of the improved algorithm was verified in experiments. Compared with the original Faster R-CNN, the improved network brings a 12.7% increase in mAP, at the detection time of 0.307s. Finally, the model with trained weights was used to test the detection of the seven types of objects in airport areas on different data sets, and comparisons were conducted with other algorithms. The experimental results showed that the method improved the average detection accuracy and had a good performance in remote sensing airport object detection tasks.
topic Airport object
image processing
multi-class object detection
pattern recognition
remote sensing
url https://ieeexplore.ieee.org/document/9186593/
work_keys_str_mv AT yongsaihan effectivecomplexairportobjectdetectioninremotesensingimagesbasedonimprovedendtoendconvolutionalneuralnetwork
AT shipingma effectivecomplexairportobjectdetectioninremotesensingimagesbasedonimprovedendtoendconvolutionalneuralnetwork
AT yueleixu effectivecomplexairportobjectdetectioninremotesensingimagesbasedonimprovedendtoendconvolutionalneuralnetwork
AT linyuanhe effectivecomplexairportobjectdetectioninremotesensingimagesbasedonimprovedendtoendconvolutionalneuralnetwork
AT shuaili effectivecomplexairportobjectdetectioninremotesensingimagesbasedonimprovedendtoendconvolutionalneuralnetwork
AT mingmingzhu effectivecomplexairportobjectdetectioninremotesensingimagesbasedonimprovedendtoendconvolutionalneuralnetwork
_version_ 1724182536307867648