TIPCB: A simple but effective part-based convolutional baseline for text-based person search

• Main Authors: Chen, Y. (Author), Lu, Y. (Author), Wang, Z. (Author), Zhang, G. (Author), Zheng, Y. (Author)
• Format: Article
• Language: English
• Published: Elsevier B.V. 2022
• Subjects: adult; article; Convolution; Cross modality; Cross-modality; Fine grained; human; Image retrieval; Local alignment; Local representation; Part based; Person search; Simple++; Subtask; Text images; Textual description
• Online Access: View Fulltext in Publisher

 Text-based person search is a sub-task in the field of image retrieval, which aims to retrieve target person images according to a given textual description. The significant feature gap between two modalities makes this task very challenging. Many existing methods attempt to utilize local alignment to address this problem in the fine-grained level. However, most relevant methods introduce additional models or complicated training and evaluation strategies, which are hard to use in realistic scenarios. In order to facilitate the practical application, we propose a simple but effective baseline for text-based person search named TIPCB (i.e., Text-Image Part-based Convolutional Baseline). Firstly, a novel dual-path local alignment network structure is proposed to extract visual and textual local representations, in which images are segmented horizontally and texts are aligned adaptively. Then, we propose a multi-stage cross-modal matching strategy, which eliminates the modality gap from three feature levels, including low level, local level and global level. Extensive experiments are conducted on the widely-used benchmark datasets (CUHK-PEDES and ICFG-PEDES) and verify that our method outperforms all the existing methods. Our code has been released in https://github.com/OrangeYHChen/TIPCB. © 2022 Elsevier B.V.