five

Generated Headlines and Annotations

收藏
arXiv2025-09-30 收录
下载链接:
https://drive.google.com/file/d/1H5hkxH2N-wl8e8y8Zd-0uVwjqCG4__og/view?usp=sharing
下载链接
链接失效反馈
官方服务:
资源简介:
该数据集包含了论文摘要、由模型生成的标题以及其标注的分类,旨在评估大型语言模型中的因果错觉。此外,该数据集还促进了分析不同语言模型生成的标题中的因果框架,并包含了诸如评估者之间一致性的Fleiss' Kappa等评估指标。该任务旨在评估模型生成标题中的因果错觉,以及这些标题与人工撰写的新闻稿之间的契合度。

This dataset comprises paper abstracts, model-generated titles, and their annotated categories, aiming to evaluate causal illusions in large language models (LLMs). Additionally, it facilitates the analysis of causal frameworks within titles generated by various language models, and includes evaluation metrics such as Fleiss' Kappa for measuring inter-annotator agreement. This task is designed to assess the causal illusions present in model-generated titles, as well as the degree of alignment between these titles and human-written press releases.
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作