Paper Reading AI Learner

Bi-Level Optimization for Self-Supervised AI-Generated Face Detection

2025-07-30 16:38:29
Mian Zou, Nan Zhong, Baosheng Yu, Yibing Zhan, Kede Ma

Abstract

AI-generated face detectors trained via supervised learning typically rely on synthesized images from specific generators, limiting their generalization to emerging generative techniques. To overcome this limitation, we introduce a self-supervised method based on bi-level optimization. In the inner loop, we pretrain a vision encoder only on photographic face images using a set of linearly weighted pretext tasks: classification of categorical exchangeable image file format (EXIF) tags, ranking of ordinal EXIF tags, and detection of artificial face manipulations. The outer loop then optimizes the relative weights of these pretext tasks to enhance the coarse-grained detection of manipulated faces, serving as a proxy task for identifying AI-generated faces. In doing so, it aligns self-supervised learning more closely with the ultimate goal of AI-generated face detection. Once pretrained, the encoder remains fixed, and AI-generated faces are detected either as anomalies under a Gaussian mixture model fitted to photographic face features or by a lightweight two-layer perceptron serving as a binary classifier. Extensive experiments demonstrate that our detectors significantly outperform existing approaches in both one-class and binary classification settings, exhibiting strong generalization to unseen generators.

Abstract (translated)

AI生成的面部检测器通过监督学习训练时,通常依赖于特定生成器合成的图像,这限制了它们对新兴生成技术的泛化能力。为克服这一局限性,我们提出了一种基于双层优化的自监督方法。在内部循环中,我们仅使用一组线性加权预设任务(如EXIF标签分类、顺序EXIF标签排序以及人工面部操作检测)对摄影人脸图像进行视觉编码器的预训练。外部循环则通过优化这些预设任务的相对权重来增强粗粒度的人脸篡改检测能力,作为识别AI生成面孔的代理任务,从而更紧密地将自监督学习与AI生成面部检测的最终目标相结合。完成预训练后,编码器保持固定状态不变,然后可以通过高斯混合模型适应摄影人脸特征下的异常检测或使用轻量级两层感知机进行二元分类来识别AI生成的人脸。 广泛的实验表明,在单类和二元分类设置下,我们的探测器在未见过的生成器上表现出显著优于现有方法的泛化能力。

URL

https://arxiv.org/abs/2507.22824

PDF

https://arxiv.org/pdf/2507.22824.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot