meer3305/xlsum

XL-Sum是一个全面且多样化的数据集，包含135万个专业标注的文章-摘要对，这些数据来自BBC，并通过一组精心设计的启发式方法提取。该数据集覆盖45种语言，从低资源到高资源语言不等，其中许多语言目前尚无公开数据集可用。XL-Sum具有高度抽象性、简洁性和高质量，这一点通过人类和内在评估得到证实。XL-Sum is a comprehensive and diverse dataset comprising 1.35 million professionally annotated article-summary pairs, which are sourced from BBC and extracted via a set of well-designed heuristic methods. This dataset covers 45 languages ranging from low-resource to high-resource ones, many of which currently lack publicly available datasets. XL-Sum features high abstraction, conciseness and superior quality, which has been validated through both human and intrinsic evaluations.