Annotation consistency.

NIAID Data Ecosystem2026-03-10 收录

标注一致性

标注信度评估

数据链接：

https://figshare.com/articles/dataset/Annotation_consistency_/4744939 数据链接链接失效反馈

官方服务：

资源简介：

Cronbach’s α and generalized additive mixed models (GAM)’s coefficient of determination (mean and standard deviation) per year.

创建时间：

2017-03-11

SKG_Based_70篇AI论文并行标注与金标准数据

知识图谱评估

标注一致性

本数据集包含4个主流科学知识图谱（OpenAlex、OpenAIRE、ORKG、Papers with Code）对70篇AI相关论文的并行类别标注，以及人工整理的语义准确的金标准标注，用于评估SKG标注质量与一致性。论文“Are Scientific Annotations Consistently Represented across Science Knowledge Graphs?”

海数据140

Overview of consensus criteria specifying the agreement-rates and corresponding disagreement-rates.

标注一致性

分类性能评估指标

Overview of consensus criteria specifying the agreement-rates and corresponding disagreement-rates.

NIAID Data Ecosystem30

Human Label Variation in Coreference (Hlava Cor)

共指消解

标注一致性

Human Label Variation in Coreference (Hlava COR) is a collection of commented multiple annotations (three annotators) of coreferential relations in Czech, i.e. the annotation of...

B2FIND20

OntoValidate: OntoNotes 5.0 NER validation dataset

命名实体识别评估

标注一致性

OntoValidate dataset consists of 603 randomly chosen raw textsfrom the original OntoNote 5.0 dataset (3637 raw texts in total). All raw texts are split into 13 subsets. Each subset was manuallyannotat

DataCite Commons2025-08-30 更新50

A comparison of the inter-annotator agreement and the classifier performance.

标注一致性

分类器性能评估

The inter-annotator agreement is computed from the examples labeled twice. The classifier performance is estimated from the 10-fold cross-validation.

Figshare2015-12-03 更新30