Paper Reading AI Learner

Contextualized Multimodal Lifelong Person Re-Identification in Hybrid Clothing States

2025-09-14 12:46:39
Robert Long, Rongxin Jiang, Mingrui Yan

Abstract

Person Re-Identification (ReID) has several challenges in real-world surveillance systems due to clothing changes (CCReID) and the need for maintaining continual learning (LReID). Previous existing methods either develop models specifically for one application, which is mostly a same-cloth (SC) setting or treat CCReID as its own separate sub-problem. In this work, we will introduce the LReID-Hybrid task with the goal of developing a model to achieve both SC and CC while learning in a continual setting. Mismatched representations and forgetting from one task to the next are significant issues, we address this with CMLReID, a CLIP-based framework composed of two novel tasks: (1) Context-Aware Semantic Prompt (CASP) that generates adaptive prompts, and also incorporates context to align richly multi-grained visual cues with semantic text space; and (2) Adaptive Knowledge Fusion and Projection (AKFP) which produces robust SC/CC prototypes through the use of a dual-path learner that aligns features with our Clothing-State-Aware Projection Loss. Experiments performed on a wide range of datasets and illustrate that CMLReID outperforms all state-of-the-art methods with strong robustness and generalization despite clothing variations and a sophisticated process of sequential learning.

Abstract (translated)

人员再识别(Re-ID)在实际的监控系统中面临若干挑战,包括因穿着变化(CCReID)和持续学习的需求(LReID)。以往的方法要么开发专门针对单一应用场景的模型,这通常是基于相同衣物设置的情况;要么将穿着变化视为一个独立的问题来处理。在这项工作中,我们将介绍LReID-Hybrid任务,旨在开发一种能够在连续学习环境中同时适应相同衣物与不同衣物情景的模型。 在从一项任务过渡到另一项任务时出现表示不匹配和遗忘问题是很重要的挑战,我们通过CMLReID(基于CLIP框架的方法)来解决这一问题。该方法由两个新颖的任务组成:(1) 具有上下文感知语义提示(Context-Aware Semantic Prompt, CASP)的任务,它可以生成自适应的提示,并将上下文信息纳入其中以对齐多粒度视觉线索与语义文本空间;以及 (2) 通过使用双路径学习器并结合衣物状态感知投影损失来产生稳健相同/不同衣物原型的自适应知识融合和投影(Adaptive Knowledge Fusion and Projection, AKFP)任务。实验在广泛的数据集上进行,结果表明CMLReID方法不仅超越了所有现有的最先进的技术,在面对服装变化的情况下还能保持强大的鲁棒性和泛化能力,并且即使是在复杂的序列学习过程中也是如此。

URL

https://arxiv.org/abs/2509.11247

PDF

https://arxiv.org/pdf/2509.11247.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot