Reddit Entity Linking

An entity linking dataset created from the social media website, Reddit. The dataset contains 619 posts and 1,243 corresponding comments that were selected and given to human annotators. Three different human annotators were used to annotate each grouping of text. The resulting mentions and entities are included with a breakdown of the inter-annotator agreement between the various mention-entity pairs. The mention-entity pairs collected are broken into groups based on the level of inter-annotator agreement. Gold annotations - all three agree Silver annotations - two out of three annotators agree Bronze annotations - an individual annotator's annotation that the other two did not have In total the dataset contains 1,342 gold annotations, 2,723 silver annotations, and 7,038 bronze annotations. A readme file is provided that describes the structure of the files and the information within each one.

本数据集为源自社交平台Reddit的实体链接（entity linking）数据集。该数据集包含619条帖子与1243条对应评论，均经筛选后交付人工标注人员完成标注。每一组待标注文本均由3名不同的人工标注人员进行标注。数据集同时收录最终提取的实体提及项（mention）与实体（entity），并附带各类提及-实体对的标注者间一致性（inter-annotator agreement）细分统计结果。所收集的提及-实体对将根据标注者间一致性等级划分为三类：金标准标注（Gold annotations）：三名标注者意见完全一致；银标标注（Silver annotations）：三名标注者中有两名达成一致意见；铜标标注（Bronze annotations）：仅单名标注者给出的标注结果，其余两名标注者未采纳该标注。整体而言，本数据集共包含1342条金标标注、2723条银标标注以及7038条铜标标注。数据集附带一份README文件，用于说明各数据文件的结构及其中包含的信息。