Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification
Unsupervised domain adaptive (UDA) person re-identification (re-ID) aims to generalize the model trained on a labeled source domain to an unlabeled target domain. Recently, the methods based on pseudo labels have achieved great success in the field of UDA person re-ID. However, pseudo label noise is...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9525100/ |
id |
doaj-7f4697be9f294908a7cdd454e0f7a4f8 |
---|---|
record_format |
Article |
spelling |
doaj-7f4697be9f294908a7cdd454e0f7a4f82021-09-06T23:00:25ZengIEEEIEEE Access2169-35362021-01-01912128812130110.1109/ACCESS.2021.31088799525100Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-IdentificationLimin Xia0https://orcid.org/0000-0002-2249-449XZhimin Yu1https://orcid.org/0000-0003-2022-4661Wentao Ma2https://orcid.org/0000-0001-7294-7939Jiahui Zhu3https://orcid.org/0000-0001-7214-2479School of Automation, Central South University, Changsha, ChinaSchool of Automation, Central South University, Changsha, ChinaSchool of Automation, Central South University, Changsha, ChinaSchool of Automation, Central South University, Changsha, ChinaUnsupervised domain adaptive (UDA) person re-identification (re-ID) aims to generalize the model trained on a labeled source domain to an unlabeled target domain. Recently, the methods based on pseudo labels have achieved great success in the field of UDA person re-ID. However, pseudo label noise is still a problem to be solved. In this paper, we propose a novel framework to refine pseudo labels for UDA person re-ID. Firstly, in order to learn more discriminative features for better clustering, we propose a No-Reference Light Enhancement network (NRLE-Net) and a novel feature extraction model called Trans-Encoder. The NRLE-Net can reduce the inter-domain and intra-domain person image style differences caused by light condition changes simultaneously, which is helpful to improve the performance of the pre-trained model in target domain and reduce the noise of initial pseudo labels. The feature extraction model Trans-Encoder is designed based on Transformer. Compared with traditional Convolutional Neural Networks (CNN), the features extracted by Trans-Encoder are more robust to domain shift. On this base, the confidence of feature clustering can be improved. Secondly, to further reduce the noise of clustering pseudo labels, we design two noise refinement strategies. One is noise correction based on neighborhood consistency and the other is noise restraint based on label confidence. Through these two strategies, our model can be effectively optimized with the noise pseudo labels. Experimental results on Market-1501, DukeMTMC-reID and MSMT17 datasets demonstrate the effectiveness of our proposed UDA person re-ID framework.https://ieeexplore.ieee.org/document/9525100/Person re-identificationunsupervised domain adaptationpseudo label refinementlight enhancementtransformer |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Limin Xia Zhimin Yu Wentao Ma Jiahui Zhu |
spellingShingle |
Limin Xia Zhimin Yu Wentao Ma Jiahui Zhu Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification IEEE Access Person re-identification unsupervised domain adaptation pseudo label refinement light enhancement transformer |
author_facet |
Limin Xia Zhimin Yu Wentao Ma Jiahui Zhu |
author_sort |
Limin Xia |
title |
Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification |
title_short |
Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification |
title_full |
Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification |
title_fullStr |
Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification |
title_full_unstemmed |
Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification |
title_sort |
refining pseudo labels for unsupervised domain adaptive person re-identification |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2021-01-01 |
description |
Unsupervised domain adaptive (UDA) person re-identification (re-ID) aims to generalize the model trained on a labeled source domain to an unlabeled target domain. Recently, the methods based on pseudo labels have achieved great success in the field of UDA person re-ID. However, pseudo label noise is still a problem to be solved. In this paper, we propose a novel framework to refine pseudo labels for UDA person re-ID. Firstly, in order to learn more discriminative features for better clustering, we propose a No-Reference Light Enhancement network (NRLE-Net) and a novel feature extraction model called Trans-Encoder. The NRLE-Net can reduce the inter-domain and intra-domain person image style differences caused by light condition changes simultaneously, which is helpful to improve the performance of the pre-trained model in target domain and reduce the noise of initial pseudo labels. The feature extraction model Trans-Encoder is designed based on Transformer. Compared with traditional Convolutional Neural Networks (CNN), the features extracted by Trans-Encoder are more robust to domain shift. On this base, the confidence of feature clustering can be improved. Secondly, to further reduce the noise of clustering pseudo labels, we design two noise refinement strategies. One is noise correction based on neighborhood consistency and the other is noise restraint based on label confidence. Through these two strategies, our model can be effectively optimized with the noise pseudo labels. Experimental results on Market-1501, DukeMTMC-reID and MSMT17 datasets demonstrate the effectiveness of our proposed UDA person re-ID framework. |
topic |
Person re-identification unsupervised domain adaptation pseudo label refinement light enhancement transformer |
url |
https://ieeexplore.ieee.org/document/9525100/ |
work_keys_str_mv |
AT liminxia refiningpseudolabelsforunsuperviseddomainadaptivepersonreidentification AT zhiminyu refiningpseudolabelsforunsuperviseddomainadaptivepersonreidentification AT wentaoma refiningpseudolabelsforunsuperviseddomainadaptivepersonreidentification AT jiahuizhu refiningpseudolabelsforunsuperviseddomainadaptivepersonreidentification |
_version_ |
1717765015479517184 |