Paper Reading AI Learner

A Dataset for Named Entity Recognition and Relation Extraction from Art-historical Image Descriptions

2026-02-22 11:29:03
Stefanie Schneider, Miriam G\"oldl, Julian Stalter, Ricarda Vollmer

Abstract

This paper introduces FRAME (Fine-grained Recognition of Art-historical Metadata and Entities), a manually annotated dataset of art-historical image descriptions for Named Entity Recognition (NER) and Relation Extraction (RE). Descriptions were collected from museum catalogs, auction listings, open-access platforms, and scholarly databases, then filtered to ensure that each text focuses on a single artwork and contains explicit statements about its material, composition, or iconography. FRAME provides stand-off annotations in three layers: a metadata layer for object-level properties, a content layer for depicted subjects and motifs, and a co-reference layer linking repeated mentions. Across layers, entity spans are labeled with 37 types and connected by typed RE links between mentions. Entity types are aligned with Wikidata to support Named Entity Linking (NEL) and downstream knowledge-graph construction. The dataset is released as UIMA XMI Common Analysis Structure (CAS) files with accompanying images and bibliographic metadata, and can be used to benchmark and fine-tune NER and RE systems, including zero- and few-shot setups with Large Language Models (LLMs).

Abstract (translated)

本文介绍了FRAME(艺术史元数据和实体的细粒度识别),这是一个由人工注释的艺术史图像描述数据集,用于命名实体识别(NER)和关系抽取(RE)。描述是从博物馆目录、拍卖清单、开放获取平台和学术数据库中收集的,经过筛选以确保每个文本聚焦于单一艺术品,并包含对其材质、构图或象征意义的具体陈述。FRAME提供了三层离散注释:元数据层用于对象级属性;内容层用于描绘的主题和动机;以及共指层连接重复提及的内容。在各层次之间,实体跨度被标记为37种类型并通过提及之间的类型化RE链接进行关联。实体类型与Wikidata对齐以支持命名实体链接(NEL)及下游知识图的构建。该数据集作为UIMA XMI通用分析结构(CAS)文件发布,并附带相关图像和文献元数据,可用于基准测试并微调NER和RE系统,包括大型语言模型(LLMs)的零样本和少样本设置。

URL

https://arxiv.org/abs/2602.19133

PDF

https://arxiv.org/pdf/2602.19133.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot