HIPE-2026 Shared Task Person-Place Relation Dataset

HIPE-2026 Data — v1.0 HIPE-2026 is a CLEF 2026 Evaluation Lab on the qualification of person–place relations in multilingual historical documents (Who was where, when?). This release contains the complete v1.0 dataset used during the official evaluation campaign. 📦 What's in this release The HIPE-2026 dataset covers two evaluation domains across two test sets: Domain A — Historical Newspapers (Test A): Articles in German, English, and French from the HIPE historical newspaper corpus (derived from HIPE-2022 impresso dataset). Entity annotations and Wikidata links were manually created in HIPE-2022. Person-Places relations were manually annotated for HIPE-2026. Evaluates both at and isAt relations. Domain B — Literary Works (Test B, surprise): A held-out test set of French literature and history works from the 16th–18th centuries, included to assess out-of-domain generalization. Evaluates at only. | Split | Domain | Languages | File(s) | |---|---|---|---| | Train | Newspapers | DE, EN, FR | data/newspapers/v1.0/HIPE-2026-v1.0-impresso-train-*.jsonl | | Test | Newspapers | DE, EN, FR | data/newspapers/v1.0/HIPE-2026-v1.0-impresso-test-*.jsonl | | Test (masked) | Newspapers | DE, EN, FR | data/newspapers/v1.0/HIPE-2026-v1.0-impresso-test_masked-*.jsonl | | Test | Literary works | FR | data/litworks/v1.0/HIPE-2026-v1.0-surprise-test-fr.jsonl | | Test (masked) | Literary works | FR | data/litworks/v1.0/HIPE-2026-v1.0-surprise-test_masked-fr.jsonl | For detailed information on tasks, datasets, and evaluation protocol, refer to the CLEF HIPE-2026 Shared Task Participation Guidelines. 🔬 Reproducing the official evaluation The full campaign evaluation — including reference data, participant submissions, and the evaluation orchestrator — is available at: 👉 https://github.com/hipe-eval/hipe-2026-eval 📐 Data format Data is distributed as UTF-8 JSON Lines (.jsonl). Each line is one document with OCR text, document metadata, and sampled person–location pairs. Prediction targets are: at — evidence that a person was at a location at any time before publication (TRUE, FALSE, PROBABLE, null) isAt — evidence of presence within ~one month before publication (TRUE, FALSE, null) The full schema is in schemas/hipe-2026-data.schema.json. See the README for format details, validation, and a prediction/evaluation walkthrough. 📖 How to cite Juri Opitz, Corina Raclé, Andrianos Michail, Matteo Romanello, Emanuela Boros, Simon Gabay, Maud Ehrmann, and Simon Clematide. 2026. Extended Overview of HIPE-2026: Evaluating Accurate and Efficient Person–Place Relation Extraction from Multilingual Historical Texts. In CLEF 2026 Working Notes, CEUR Workshop Proceedings. https://doi.org/10.5281/zenodo.20344461 📜 License Released under CC BY-NC-SA 4.0. HIPE-2026 is organised within the Impresso project, funded by the Swiss National Science Foundation (grant CRSII5_213585) and the Luxembourg National Research Fund (grant 17498891).HIPE-2026 数据集 — v1.0版 HIPE-2026 是CLEF 2026评估实验室项目，聚焦多语言历史文档中的人物-地点关系判定任务（即“何人、何地、何时”）。本发布包包含官方评估活动中使用的完整v1.0版数据集。 📦 本发布包内容 HIPE-2026 数据集覆盖两个评估领域，对应两套测试集： 领域A — 历史报纸（测试集A）：来自HIPE历史报纸语料库（衍生自HIPE-2022 impresso数据集）的德语、英语、法语文本。实体标注与维基数据（Wikidata）链接已于HIPE-2022阶段完成人工构建，人物-地点关系则为HIPE-2026阶段新增的人工标注内容。本测试集同时评估`at`与`isAt`两类关系。 领域B — 文学作品（测试集B，惊喜测试集）：该测试集为16至18世纪法语文学与历史作品的预留测试集，用于评估模型的跨领域泛化能力。本测试集仅评估`at`关系。 | 划分集 | 领域 | 语言 | 文件路径 | |---|---|---|---| | 训练集 | 报纸领域 | 德、英、法 | data/newspapers/v1.0/HIPE-2026-v1.0-impresso-train-*.jsonl | | 测试集 | 报纸领域 | 德、英、法 | data/newspapers/v1.0/HIPE-2026-v1.0-impresso-test-*.jsonl | | 掩码测试集 | 报纸领域 | 德、英、法 | data/newspapers/v1.0/HIPE-2026-v1.0-impresso-test_masked-*.jsonl | | 测试集 | 文学作品 | 法语 | data/litworks/v1.0/HIPE-2026-v1.0-surprise-test-fr.jsonl | | 掩码测试集 | 文学作品 | 法语 | data/litworks/v1.0/HIPE-2026-v1.0-surprise-test_masked-fr.jsonl | 如需了解任务、数据集与评估协议的详细信息，请参阅《CLEF HIPE-2026 共享任务参与指南》。 🔬 官方评估复现 完整的活动评估方案（包含参考数据、参赛提交结果与评估编排工具）可通过以下链接获取：👉 https://github.com/hipe-eval/hipe-2026-eval 📐 数据格式 数据集采用UTF-8编码的JSON Lines（.jsonl）格式分发。每行对应一篇文档，包含光学字符识别（OCR）文本、文档元数据与采样得到的人物-地点配对样本。预测目标包括： `at`：表征人物在文档发布前任意时间点处于某一地点的证据，取值为TRUE（是）、FALSE（否）、PROBABLE（可能）或null（无信息） `isAt`：表征人物在文档发布前约一个月内处于该地点的证据，取值同上。 完整的数据模式（schema）定义位于schemas/hipe-2026-data.schema.json文件中。如需了解格式细节、数据校验方法与预测/评估流程指南，请参阅README文件。 📖 引用方式 Juri Opitz、Corina Raclé、Andrianos Michail、Matteo Romanello、Emanuela Boros、Simon Gabay、Maud Ehrmann 与 Simon Clematide. 2026. 《HIPE-2026 扩展概述：从多语言历史文本中精准高效抽取人物-地点关系》. 载于 CLEF 2026 工作笔记（CEUR Workshop Proceedings）. https://doi.org/10.5281/zenodo.20344461 📜 授权协议 本数据集采用CC BY-NC-SA 4.0协议发布。 HIPE-2026 项目依托Impresso项目开展，该项目获得瑞士国家科学基金会（资助编号CRSII5_213585）与卢森堡国家研究基金（资助编号17498891）资助。