Paper Reading AI Learner

Attention over Scene Graphs: Indoor Scene Representations Toward CSAI Classification

2025-09-30 16:09:34
Artur Barros, Carlos Caetano, Jo\~ao Macedo, Jefersson A. dos Santos, Sandra Avila

Abstract

Indoor scene classification is a critical task in computer vision, with wide-ranging applications that go from robotics to sensitive content analysis, such as child sexual abuse imagery (CSAI) classification. The problem is particularly challenging due to the intricate relationships between objects and complex spatial layouts. In this work, we propose the Attention over Scene Graphs for Sensitive Content Analysis (ASGRA), a novel framework that operates on structured graph representations instead of raw pixels. By first converting images into Scene Graphs and then employing a Graph Attention Network for inference, ASGRA directly models the interactions between a scene's components. This approach offers two key benefits: (i) inherent explainability via object and relationship identification, and (ii) privacy preservation, enabling model training without direct access to sensitive images. On Places8, we achieve 81.27% balanced accuracy, surpassing image-based methods. Real-world CSAI evaluation with law enforcement yields 74.27% balanced accuracy. Our results establish structured scene representations as a robust paradigm for indoor scene classification and CSAI classification. Code is publicly available at this https URL.

Abstract (translated)

室内场景分类是计算机视觉中的一个重要任务,其应用范围广泛,从机器人技术到敏感内容分析(如儿童性虐待图像(CSAI) 分类)都有涉及。该问题由于物体之间的复杂关系和空间布局的多样性而特别具有挑战性。在本文中,我们提出了一个新的框架——用于敏感内容分析的场景图注意力 (ASGRA),它基于结构化的图表示而非原始像素进行操作。首先将图像转换为场景图,然后使用图注意力网络进行推理,ASGRA 直接建模场景组件之间的交互。这种方法提供了两个关键优势:(i) 通过识别对象和关系提供内在的可解释性;(ii) 保护隐私,在无需直接访问敏感图片的情况下就可以训练模型。 在 Places8 数据集上,我们达到了 81.27% 的平衡准确率,超过了基于图像的方法。与执法部门合作进行的真实世界 CSAI 测试中,我们的方法实现了 74.27% 的平衡准确率。我们的结果确立了结构化的场景表示作为一种稳健的室内场景分类和 CSAI 分类范式。代码可在以下网址公开获取:[此 URL] (请将此占位符替换为实际链接)。

URL

https://arxiv.org/abs/2509.26457

PDF

https://arxiv.org/pdf/2509.26457.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot