ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization
One-stage object detectors are simple and efficient; however, they cannot extract sufficient object features due to simplistic structures. At the same time, the classification score cannot reflect the actual positioning of the candidate box. Therefore, it is not accurate to use classification score...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9293286/ |
id |
doaj-082fce1098fc4f1ea36d9e494907759d |
---|---|
record_format |
Article |
spelling |
doaj-082fce1098fc4f1ea36d9e494907759d2021-03-30T04:43:23ZengIEEEIEEE Access2169-35362020-01-01822505222506310.1109/ACCESS.2020.30445649293286ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate LocalizationJiexian Zeng0https://orcid.org/0000-0002-7254-2170Jiale Xiong1https://orcid.org/0000-0001-5482-285XXiang Fu2https://orcid.org/0000-0003-3799-0768Lu Leng3https://orcid.org/0000-0002-5667-224XSchool of Software, Nanchang Hangkong University, Nanchang, ChinaSchool of Software, Nanchang Hangkong University, Nanchang, ChinaSchool of Software, Nanchang Hangkong University, Nanchang, ChinaSchool of Software, Nanchang Hangkong University, Nanchang, ChinaOne-stage object detectors are simple and efficient; however, they cannot extract sufficient object features due to simplistic structures. At the same time, the classification score cannot reflect the actual positioning of the candidate box. Therefore, it is not accurate to use classification score only as the candidate box position score in non-maximum suppression (NMS) stage. These two shortcomings degrade the detection accuracy. In this paper, a novel feature pyramid architecture named refined feature pyramid network (ReFPN) is introduced to obtain better object features. ReFPN designs a refined module which is parallel with feature pyramid network (FPN) to extract the semantic features of objects, and then the extraction of features are used to optimize the features of FPN by summation. In addition, we design the refined center-ness (RCenter-ness) branch that predicts the position score of each point on the feature map to improve the localization accuracy. The predicted position score is multiplied by the classification score to obtain the final position score that has a stronger correlation with localization accuracy. The final position score is inputted to the subsequent NMS, which improves localization accuracy. The proposed method in this paper is named ReFPN-FCOS. The sufficient experiments on COCO2017 datasets demonstrate the effectiveness of ReFPN-FCOS on improving classification accuracy and localization accuracy. The average precisions of this method achieve 1.1% and 1.3 % higher than those of FCOS, when using ResNet50 and ResNet101 as backbone respectively. Code download link: https://github.com/xjl-le/mmdete.https://ieeexplore.ieee.org/document/9293286/Refined center-ness branchrefined FPNfusion classification and location |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jiexian Zeng Jiale Xiong Xiang Fu Lu Leng |
spellingShingle |
Jiexian Zeng Jiale Xiong Xiang Fu Lu Leng ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization IEEE Access Refined center-ness branch refined FPN fusion classification and location |
author_facet |
Jiexian Zeng Jiale Xiong Xiang Fu Lu Leng |
author_sort |
Jiexian Zeng |
title |
ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization |
title_short |
ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization |
title_full |
ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization |
title_fullStr |
ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization |
title_full_unstemmed |
ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization |
title_sort |
refpn-fcos: one-stage object detection for feature learning and accurate localization |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
One-stage object detectors are simple and efficient; however, they cannot extract sufficient object features due to simplistic structures. At the same time, the classification score cannot reflect the actual positioning of the candidate box. Therefore, it is not accurate to use classification score only as the candidate box position score in non-maximum suppression (NMS) stage. These two shortcomings degrade the detection accuracy. In this paper, a novel feature pyramid architecture named refined feature pyramid network (ReFPN) is introduced to obtain better object features. ReFPN designs a refined module which is parallel with feature pyramid network (FPN) to extract the semantic features of objects, and then the extraction of features are used to optimize the features of FPN by summation. In addition, we design the refined center-ness (RCenter-ness) branch that predicts the position score of each point on the feature map to improve the localization accuracy. The predicted position score is multiplied by the classification score to obtain the final position score that has a stronger correlation with localization accuracy. The final position score is inputted to the subsequent NMS, which improves localization accuracy. The proposed method in this paper is named ReFPN-FCOS. The sufficient experiments on COCO2017 datasets demonstrate the effectiveness of ReFPN-FCOS on improving classification accuracy and localization accuracy. The average precisions of this method achieve 1.1% and 1.3 % higher than those of FCOS, when using ResNet50 and ResNet101 as backbone respectively. Code download link: https://github.com/xjl-le/mmdete. |
topic |
Refined center-ness branch refined FPN fusion classification and location |
url |
https://ieeexplore.ieee.org/document/9293286/ |
work_keys_str_mv |
AT jiexianzeng refpnfcosonestageobjectdetectionforfeaturelearningandaccuratelocalization AT jialexiong refpnfcosonestageobjectdetectionforfeaturelearningandaccuratelocalization AT xiangfu refpnfcosonestageobjectdetectionforfeaturelearningandaccuratelocalization AT luleng refpnfcosonestageobjectdetectionforfeaturelearningandaccuratelocalization |
_version_ |
1724181289215459328 |