2 × 2 Contingency table for two annotators.

NIAID Data Ecosystem2026-03-14 收录

标注一致性

标注信度评估

数据链接：

https://figshare.com/articles/dataset/2_2_Contingency_table_for_two_annotators_/21934764 数据链接链接失效反馈

官方服务：

资源简介：

2 × 2 Contingency table for two annotators.

创建时间：

2023-01-20

SKG_Based_70篇AI论文并行标注与金标准数据

知识图谱评估

标注一致性

本数据集包含4个主流科学知识图谱（OpenAlex、OpenAIRE、ORKG、Papers with Code）对70篇AI相关论文的并行类别标注，以及人工整理的语义准确的金标准标注，用于评估SKG标注质量与一致性。论文“Are Scientific Annotations Consistently Represented across Science Knowledge Graphs?”

海数据140

Annotation consistency.

标注一致性

标注信度评估

Cronbach’s α and generalized additive mixed models (GAM)’s coefficient of determination (mean and standard deviation) per year.

NIAID Data Ecosystem50

A comparison of the inter-annotator agreement and the classifier performance.

标注一致性

分类器性能评估

The inter-annotator agreement is computed from the examples labeled twice. The classifier performance is estimated from the 10-fold cross-validation.

Figshare2015-12-03 更新30

OntoValidate: OntoNotes 5.0 NER validation dataset

命名实体识别评估

标注一致性

OntoValidate dataset consists of 603 randomly chosen raw textsfrom the original OntoNote 5.0 dataset (3637 raw texts in total). All raw texts are split into 13 subsets. Each subset was manuallyannotat

DataCite Commons2025-08-30 更新50

Overview of consensus criteria specifying the agreement-rates and corresponding disagreement-rates.

标注一致性

分类性能评估指标

Overview of consensus criteria specifying the agreement-rates and corresponding disagreement-rates.

NIAID Data Ecosystem30