Generated Headlines and Annotations
收藏arXiv2025-09-30 收录
下载链接:
https://drive.google.com/file/d/1H5hkxH2N-wl8e8y8Zd-0uVwjqCG4__og/view?usp=sharing
下载链接
链接失效反馈官方服务:
资源简介:
该数据集包含了论文摘要、由模型生成的标题以及其标注的分类,旨在评估大型语言模型中的因果错觉。此外,该数据集还促进了分析不同语言模型生成的标题中的因果框架,并包含了诸如评估者之间一致性的Fleiss' Kappa等评估指标。该任务旨在评估模型生成标题中的因果错觉,以及这些标题与人工撰写的新闻稿之间的契合度。
This dataset comprises paper abstracts, model-generated titles, and their annotated categories, aiming to evaluate causal illusions in large language models (LLMs). Additionally, it facilitates the analysis of causal frameworks within titles generated by various language models, and includes evaluation metrics such as Fleiss' Kappa for measuring inter-annotator agreement. This task is designed to assess the causal illusions present in model-generated titles, as well as the degree of alignment between these titles and human-written press releases.



