LM-Polygraph/wmt19

这是一个用于LM-Polygraph基准测试的wmt19数据集的预处理版本。数据集包含训练和测试两个分割，每个分割包含输入和输出两个字符串列。数据集是从wmt19数据集收集并处理的，具有与源数据集相同的偏见、风险和限制。

This is a preprocessed version of the wmt19 dataset, specifically designed for benchmarks in LM-Polygraph. The dataset includes train and test splits, each containing input and output string columns. The creation of this dataset aims to separate dataset creation code from benchmarking code. The data originates from huggingface.co/datasets/wmt19 and is processed using the build_dataset.py script in the repository.