CLEARFACTS and GRAYFACTS
收藏arXiv2025-06-16 更新2025-11-28 收录
下载链接：
https://github.com/just1nseo/verifying-the-verifiers
下载链接
链接失效反馈官方服务：
资源简介：
CLEARFACTS和GRAYFACTS数据集是为了评估事实核查模型的可靠性而创建的，包含来自14个事实核查基准的示例。数据集包含1,749个实例，通过过滤和标注过程构建，旨在解决事实核查模型中存在的标注错误和歧义问题。CLEARFACTS数据集由修正后的实例组成，用于评估模型的性能；而GRAYFACTS数据集包含所有歧义实例，用于分析模型在处理这些实例时的行为。
The CLEARFACTS and GRAYFACTS datasets were developed to evaluate the reliability of fact-checking models, incorporating examples sourced from 14 fact-checking benchmarks. Comprising 1,749 instances constructed via a filtering and annotation pipeline, these datasets are intended to address the annotation errors and ambiguity issues inherent in existing fact-checking models. The CLEARFACTS dataset consists of revised instances for model performance evaluation, whereas the GRAYFACTS dataset includes all ambiguous instances designed for analyzing the behaviors of models when processing such cases.
提供机构：
Yonsei University, Stanford University, University of Washington
创建时间：
2025-06-16
