Paper Reading AI Learner

ChatReID: Open-ended Interactive Person Retrieval via Hierarchical Progressive Tuning for Vision Language Models

2025-02-27 10:34:14
Ke Niu, Haiyang Yu, Mengyang Zhao, Teng Fu, Siyang Yi, Wei Lu, Bin Li, Xuelin Qian, Xiangyang Xue

Abstract

Person re-identification (Re-ID) is a critical task in human-centric intelligent systems, enabling consistent identification of individuals across different camera views using multi-modal query information. Recent studies have successfully integrated LVLMs with person Re-ID, yielding promising results. However, existing LVLM-based methods face several limitations. They rely on extracting textual embeddings from fixed templates, which are used either as intermediate features for image representation or for prompt tuning in domain-specific tasks. Furthermore, they are unable to adopt the VQA inference format, significantly restricting their broader applicability. In this paper, we propose a novel, versatile, one-for-all person Re-ID framework, ChatReID. Our approach introduces a Hierarchical Progressive Tuning (HPT) strategy, which ensures fine-grained identity-level retrieval by progressively refining the model's ability to distinguish pedestrian identities. Extensive experiments demonstrate that our approach outperforms SOTA methods across ten benchmarks in four different Re-ID settings, offering enhanced flexibility and user-friendliness. ChatReID provides a scalable, practical solution for real-world person Re-ID applications, enabling effective multi-modal interaction and fine-grained identity discrimination.

Abstract (translated)

人员再识别(Re-ID)是基于人类的智能系统中的一个关键任务,它能够利用多模态查询信息在不同的摄像机视角下持续地对个人进行一致的身份识别。最近的研究成功地将大型视觉语言模型(LVLMs)与人员Re-ID结合在一起,取得了很有前景的结果。然而,现有的基于LVLM的方法面临多个限制。它们依赖于从固定模板中提取文本嵌入,并将其用作图像表示的中间特征或用于特定领域的提示微调。此外,这些方法无法采用视觉问答(VQA)推理格式,这极大地限制了它们在更广泛的应用场景中的适用性。 在这篇论文中,我们提出了一种新颖、多功能且适用于所有情况的人员Re-ID框架——ChatReID。我们的方法引入了一个分层逐步微调(Hierarchical Progressive Tuning, HPT)策略,通过逐步提高模型区分行人身份的能力,确保了精细粒度的身份级检索。广泛的实验表明,在四个不同的Re-ID设置下的十个基准测试中,我们提出的方法优于现有的最先进方法,提供了增强的灵活性和用户友好性。ChatReID为现实世界中的人员Re-ID应用提供了一个可扩展且实用的解决方案,支持有效的多模态交互与精细粒度的身份区分。

URL

https://arxiv.org/abs/2502.19958

PDF

https://arxiv.org/pdf/2502.19958.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot