five

FailureScope Single-Turn Corpus (NeurIPS 2026 E&D)

收藏
DataCite Commons2026-05-05 更新2026-05-07 收录
下载链接:
https://zenodo.org/doi/10.5281/zenodo.20034012
下载链接
链接失效反馈
官方服务:
资源简介:
FailureScope single-turn corpus: 2,664 tasks pooled from GSM8K, ARC-Challenge, MMLU, HumanEval, MBPP, and IFEval, evaluated across 18 language models (1.3B to 70B+ parameters). Each record contains the task prompt, source benchmark, gold answer, per-model pass/fail labels, taxonomy assignment, and the leave-one-model-out (LOMO) clustering cluster ID. Released to support reproducible cross-model behavioral diagnosis. This dataset is one of three components of the FailureScope release (single-turn, multi-turn, adversarial); see related identifiers on the umbrella record DOI 10.5281/zenodo.20037167. Companion Croissant 1.0 metadata file is bundled with the FailureScope Croissant package on the umbrella record. Usage and field schema are documented in the included README and the paper appendix.
提供机构:
Zenodo
创建时间:
2026-05-05
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作