Wiki Benchmark (Wiki-BM) 和 Contract Benchmark (Cont-BM)

Wiki Benchmark (Wiki-BM) 和 Contract Benchmark (Cont-BM) 是由宾夕法尼亚大学和IBM Research合作创建的两个数据集，用于评估文本简化任务中的Split and Rephrase性能。Wiki-BM包含从Wikipedia中随机选择的500个复杂句子，而Cont-BM则从法律文档中收集了500个句子。这两个数据集都经过严格的质量控制，确保每个复杂句子都有多个高质量的简化版本。数据集的应用领域包括提高机器翻译和信息提取系统的性能，以及帮助非母语读者更好地理解复杂文本。Wiki Benchmark (Wiki-BM) and Contract Benchmark (Cont-BM) are two datasets jointly developed by the University of Pennsylvania and IBM Research, designed to evaluate the Split and Rephrase performance in text simplification tasks. Wiki-BM includes 500 complex sentences randomly selected from Wikipedia, while Cont-BM collects 500 sentences from legal documents. Both datasets have undergone strict quality control to ensure that each complex sentence is paired with multiple high-quality simplified versions. The application domains of these datasets cover enhancing the performance of machine translation and information extraction systems, as well as assisting non-native readers to better comprehend complex texts.

搜集汇总

背景与挑战

背景概述

该数据集是用于文本简化中分割和重述（Split and Rephrase）任务的基准数据集，由IBM Research开发。它包含Wiki Benchmark (Wiki-BM) 和 Contract Benchmark (Cont-BM) 两个子集，旨在将复杂句子分割并重述为更简单的句子，相关研究发表于EMNLP 2020会议。