Salesforce/summexecedit
收藏Hugging Face2024-12-19 更新2024-12-21 收录
下载链接：
https://hf-mirror.com/datasets/Salesforce/summexecedit
下载链接
链接失效反馈官方服务：
资源简介：
SummExecEdit基准测试用于评估模型在摘要中检测和解释事实不一致性的能力。该基准测试基于之前的SummEdits基准测试，通过可执行编辑机制生成了新的不一致和具有挑战性的摘要。数据集包含4,241个样本，涵盖了10个领域，每个样本包含多个字段，如样本ID、文档ID、输入文档、原始摘要、原始文本、替换文本、编辑后的摘要、解释、领域、模型和编辑类型等。
The SummExecEdit dataset is designed to evaluate a models ability to detect and explain factual inconsistencies in summaries. The dataset contains 4,241 samples across 10 domains, with each sample including fields such as document ID, document content, original summary, replacement text, edited summary, explanation, domain, model, and edit type. The dataset generates new inconsistent and challenging summaries using an executable editing mechanism.
提供机构：
Salesforce
