hpprc/enwiki-translations

该数据集是通过使用LLM将英语Wikipedia翻译成日语而创建的。`collection`子集包含原始的英语Wikipedia文章，而`dataset`子集包含英日翻译的文本对以及原始文章在`collection`子集中的ID。使用这些数据时，需要遵守用于翻译的各模型的输出许可证条款。特别是，使用Phi3.5 MoE模型创建的数据遵循Wikipedia的许可证，可以在CC-BY-SA 4.0下使用。

This dataset was created by translating English Wikipedia into Japanese using LLM. The `collection` subset contains the original English Wikipedia articles, while the `dataset` subset contains English-Japanese translated text pairs and the IDs of the original articles in the `collection` subset. When using these data, it is necessary to comply with the license terms of the outputs of the models used for translation. In particular, data created using the Phi3.5 MoE model follows the Wikipedia license and can be used under CC-BY-SA 4.0.