ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization

One-stage object detectors are simple and efficient; however, they cannot extract sufficient object features due to simplistic structures. At the same time, the classification score cannot reflect the actual positioning of the candidate box. Therefore, it is not accurate to use classification score...

Full description

Bibliographic Details
Main Authors: Jiexian Zeng, Jiale Xiong, Xiang Fu, Lu Leng
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9293286/
id doaj-082fce1098fc4f1ea36d9e494907759d
record_format Article
spelling doaj-082fce1098fc4f1ea36d9e494907759d2021-03-30T04:43:23ZengIEEEIEEE Access2169-35362020-01-01822505222506310.1109/ACCESS.2020.30445649293286ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate LocalizationJiexian Zeng0https://orcid.org/0000-0002-7254-2170Jiale Xiong1https://orcid.org/0000-0001-5482-285XXiang Fu2https://orcid.org/0000-0003-3799-0768Lu Leng3https://orcid.org/0000-0002-5667-224XSchool of Software, Nanchang Hangkong University, Nanchang, ChinaSchool of Software, Nanchang Hangkong University, Nanchang, ChinaSchool of Software, Nanchang Hangkong University, Nanchang, ChinaSchool of Software, Nanchang Hangkong University, Nanchang, ChinaOne-stage object detectors are simple and efficient; however, they cannot extract sufficient object features due to simplistic structures. At the same time, the classification score cannot reflect the actual positioning of the candidate box. Therefore, it is not accurate to use classification score only as the candidate box position score in non-maximum suppression (NMS) stage. These two shortcomings degrade the detection accuracy. In this paper, a novel feature pyramid architecture named refined feature pyramid network (ReFPN) is introduced to obtain better object features. ReFPN designs a refined module which is parallel with feature pyramid network (FPN) to extract the semantic features of objects, and then the extraction of features are used to optimize the features of FPN by summation. In addition, we design the refined center-ness (RCenter-ness) branch that predicts the position score of each point on the feature map to improve the localization accuracy. The predicted position score is multiplied by the classification score to obtain the final position score that has a stronger correlation with localization accuracy. The final position score is inputted to the subsequent NMS, which improves localization accuracy. The proposed method in this paper is named ReFPN-FCOS. The sufficient experiments on COCO2017 datasets demonstrate the effectiveness of ReFPN-FCOS on improving classification accuracy and localization accuracy. The average precisions of this method achieve 1.1% and 1.3 % higher than those of FCOS, when using ResNet50 and ResNet101 as backbone respectively. Code download link: https://github.com/xjl-le/mmdete.https://ieeexplore.ieee.org/document/9293286/Refined center-ness branchrefined FPNfusion classification and location
collection DOAJ
language English
format Article
sources DOAJ
author Jiexian Zeng
Jiale Xiong
Xiang Fu
Lu Leng
spellingShingle Jiexian Zeng
Jiale Xiong
Xiang Fu
Lu Leng
ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization
IEEE Access
Refined center-ness branch
refined FPN
fusion classification and location
author_facet Jiexian Zeng
Jiale Xiong
Xiang Fu
Lu Leng
author_sort Jiexian Zeng
title ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization
title_short ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization
title_full ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization
title_fullStr ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization
title_full_unstemmed ReFPN-FCOS: One-Stage Object Detection for Feature Learning and Accurate Localization
title_sort refpn-fcos: one-stage object detection for feature learning and accurate localization
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description One-stage object detectors are simple and efficient; however, they cannot extract sufficient object features due to simplistic structures. At the same time, the classification score cannot reflect the actual positioning of the candidate box. Therefore, it is not accurate to use classification score only as the candidate box position score in non-maximum suppression (NMS) stage. These two shortcomings degrade the detection accuracy. In this paper, a novel feature pyramid architecture named refined feature pyramid network (ReFPN) is introduced to obtain better object features. ReFPN designs a refined module which is parallel with feature pyramid network (FPN) to extract the semantic features of objects, and then the extraction of features are used to optimize the features of FPN by summation. In addition, we design the refined center-ness (RCenter-ness) branch that predicts the position score of each point on the feature map to improve the localization accuracy. The predicted position score is multiplied by the classification score to obtain the final position score that has a stronger correlation with localization accuracy. The final position score is inputted to the subsequent NMS, which improves localization accuracy. The proposed method in this paper is named ReFPN-FCOS. The sufficient experiments on COCO2017 datasets demonstrate the effectiveness of ReFPN-FCOS on improving classification accuracy and localization accuracy. The average precisions of this method achieve 1.1% and 1.3 % higher than those of FCOS, when using ResNet50 and ResNet101 as backbone respectively. Code download link: https://github.com/xjl-le/mmdete.
topic Refined center-ness branch
refined FPN
fusion classification and location
url https://ieeexplore.ieee.org/document/9293286/
work_keys_str_mv AT jiexianzeng refpnfcosonestageobjectdetectionforfeaturelearningandaccuratelocalization
AT jialexiong refpnfcosonestageobjectdetectionforfeaturelearningandaccuratelocalization
AT xiangfu refpnfcosonestageobjectdetectionforfeaturelearningandaccuratelocalization
AT luleng refpnfcosonestageobjectdetectionforfeaturelearningandaccuratelocalization
_version_ 1724181289215459328