Paper Reading AI Learner

Multi-modal Multi-platform Person Re-Identification: Benchmark and Method

2025-03-21 12:27:49
Ruiyang Ha, Songyi Jiang, Bin Li, Bikang Pan, Yihang Zhu, Junjie Zhang, Xiatian Zhu, Shaogang Gong, Jingya Wang

Abstract

Conventional person re-identification (ReID) research is often limited to single-modality sensor data from static cameras, which fails to address the complexities of real-world scenarios where multi-modal signals are increasingly prevalent. For instance, consider an urban ReID system integrating stationary RGB cameras, nighttime infrared sensors, and UAVs equipped with dynamic tracking capabilities. Such systems face significant challenges due to variations in camera perspectives, lighting conditions, and sensor modalities, hindering effective person ReID. To address these challenges, we introduce the MP-ReID benchmark, a novel dataset designed specifically for multi-modality and multi-platform ReID. This benchmark uniquely compiles data from 1,930 identities across diverse modalities, including RGB, infrared, and thermal imaging, captured by both UAVs and ground-based cameras in indoor and outdoor environments. Building on this benchmark, we introduce Uni-Prompt ReID, a framework with specific-designed prompts, tailored for cross-modality and cross-platform scenarios. Our method consistently outperforms state-of-the-art approaches, establishing a robust foundation for future research in complex and dynamic ReID environments. Our dataset are available at:this https URL.

Abstract (translated)

传统的人员再识别(ReID)研究通常局限于静态摄像头采集的单一模态传感器数据,这无法应对现实场景中的复杂性问题,这些场景中多模态信号越来越普遍。例如,在一个集成固定RGB相机、夜间红外传感器和装有动态跟踪能力无人机的城市ReID系统中,由于视角变化、光照条件以及传感器模式的不同,这类系统面临着重大挑战,阻碍了有效的人体再识别。为了解决这些问题,我们引入了MP-ReID基准测试,这是一个专门针对多模态和跨平台人员再识别的新数据集。该基准测试从1,930个不同身份中收集了多样化的模态数据,包括RGB、红外和热成像图像,并且这些数据由无人机和地面相机在室内和室外环境中捕获。 基于这一基准,我们提出了Uni-Prompt ReID框架,这是一个设计有特定提示的系统,专为跨模态和多平台场景而量身定制。我们的方法在各种测试中始终超越现有最先进技术,奠定了未来复杂且动态环境下的ReID研究的基础。 数据集可以在以下网址获取:[此链接](this%20https%20URL)

URL

https://arxiv.org/abs/2503.17096

PDF

https://arxiv.org/pdf/2503.17096.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot