Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification

Unsupervised domain adaptive (UDA) person re-identification (re-ID) aims to generalize the model trained on a labeled source domain to an unlabeled target domain. Recently, the methods based on pseudo labels have achieved great success in the field of UDA person re-ID. However, pseudo label noise is...

Full description

Bibliographic Details
Main Authors: Limin Xia, Zhimin Yu, Wentao Ma, Jiahui Zhu
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9525100/
id doaj-7f4697be9f294908a7cdd454e0f7a4f8
record_format Article
spelling doaj-7f4697be9f294908a7cdd454e0f7a4f82021-09-06T23:00:25ZengIEEEIEEE Access2169-35362021-01-01912128812130110.1109/ACCESS.2021.31088799525100Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-IdentificationLimin Xia0https://orcid.org/0000-0002-2249-449XZhimin Yu1https://orcid.org/0000-0003-2022-4661Wentao Ma2https://orcid.org/0000-0001-7294-7939Jiahui Zhu3https://orcid.org/0000-0001-7214-2479School of Automation, Central South University, Changsha, ChinaSchool of Automation, Central South University, Changsha, ChinaSchool of Automation, Central South University, Changsha, ChinaSchool of Automation, Central South University, Changsha, ChinaUnsupervised domain adaptive (UDA) person re-identification (re-ID) aims to generalize the model trained on a labeled source domain to an unlabeled target domain. Recently, the methods based on pseudo labels have achieved great success in the field of UDA person re-ID. However, pseudo label noise is still a problem to be solved. In this paper, we propose a novel framework to refine pseudo labels for UDA person re-ID. Firstly, in order to learn more discriminative features for better clustering, we propose a No-Reference Light Enhancement network (NRLE-Net) and a novel feature extraction model called Trans-Encoder. The NRLE-Net can reduce the inter-domain and intra-domain person image style differences caused by light condition changes simultaneously, which is helpful to improve the performance of the pre-trained model in target domain and reduce the noise of initial pseudo labels. The feature extraction model Trans-Encoder is designed based on Transformer. Compared with traditional Convolutional Neural Networks (CNN), the features extracted by Trans-Encoder are more robust to domain shift. On this base, the confidence of feature clustering can be improved. Secondly, to further reduce the noise of clustering pseudo labels, we design two noise refinement strategies. One is noise correction based on neighborhood consistency and the other is noise restraint based on label confidence. Through these two strategies, our model can be effectively optimized with the noise pseudo labels. Experimental results on Market-1501, DukeMTMC-reID and MSMT17 datasets demonstrate the effectiveness of our proposed UDA person re-ID framework.https://ieeexplore.ieee.org/document/9525100/Person re-identificationunsupervised domain adaptationpseudo label refinementlight enhancementtransformer
collection DOAJ
language English
format Article
sources DOAJ
author Limin Xia
Zhimin Yu
Wentao Ma
Jiahui Zhu
spellingShingle Limin Xia
Zhimin Yu
Wentao Ma
Jiahui Zhu
Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification
IEEE Access
Person re-identification
unsupervised domain adaptation
pseudo label refinement
light enhancement
transformer
author_facet Limin Xia
Zhimin Yu
Wentao Ma
Jiahui Zhu
author_sort Limin Xia
title Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification
title_short Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification
title_full Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification
title_fullStr Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification
title_full_unstemmed Refining Pseudo Labels for Unsupervised Domain Adaptive Person Re-Identification
title_sort refining pseudo labels for unsupervised domain adaptive person re-identification
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description Unsupervised domain adaptive (UDA) person re-identification (re-ID) aims to generalize the model trained on a labeled source domain to an unlabeled target domain. Recently, the methods based on pseudo labels have achieved great success in the field of UDA person re-ID. However, pseudo label noise is still a problem to be solved. In this paper, we propose a novel framework to refine pseudo labels for UDA person re-ID. Firstly, in order to learn more discriminative features for better clustering, we propose a No-Reference Light Enhancement network (NRLE-Net) and a novel feature extraction model called Trans-Encoder. The NRLE-Net can reduce the inter-domain and intra-domain person image style differences caused by light condition changes simultaneously, which is helpful to improve the performance of the pre-trained model in target domain and reduce the noise of initial pseudo labels. The feature extraction model Trans-Encoder is designed based on Transformer. Compared with traditional Convolutional Neural Networks (CNN), the features extracted by Trans-Encoder are more robust to domain shift. On this base, the confidence of feature clustering can be improved. Secondly, to further reduce the noise of clustering pseudo labels, we design two noise refinement strategies. One is noise correction based on neighborhood consistency and the other is noise restraint based on label confidence. Through these two strategies, our model can be effectively optimized with the noise pseudo labels. Experimental results on Market-1501, DukeMTMC-reID and MSMT17 datasets demonstrate the effectiveness of our proposed UDA person re-ID framework.
topic Person re-identification
unsupervised domain adaptation
pseudo label refinement
light enhancement
transformer
url https://ieeexplore.ieee.org/document/9525100/
work_keys_str_mv AT liminxia refiningpseudolabelsforunsuperviseddomainadaptivepersonreidentification
AT zhiminyu refiningpseudolabelsforunsuperviseddomainadaptivepersonreidentification
AT wentaoma refiningpseudolabelsforunsuperviseddomainadaptivepersonreidentification
AT jiahuizhu refiningpseudolabelsforunsuperviseddomainadaptivepersonreidentification
_version_ 1717765015479517184