ali-issa/eng_aya_dataset
收藏Hugging Face2025-01-27 更新2025-02-15 收录
下载链接:
https://hf-mirror.com/datasets/ali-issa/eng_aya_dataset
下载链接
链接失效反馈官方服务:
资源简介:
Aya数据集包括16个经过选择的子数据集,这些数据集适合用于训练两个大型语言模型,一个用于英语,另一个用于阿拉伯语。该数据集最初包含19个子数据集,涵盖101种语言,但由于部分数据集翻译不完整或有误,最终只采用了16个子数据集。排除的数据集包括CNN Daily Mail、XLEL-WD和SODA。
The Aya dataset includes 16 selected sub-datasets suitable for training two large language models, one for English and the other for Arabic. The dataset originally contained 19 sub-datasets across 101 languages, but only 16 were eventually used due to incomplete or erroneous translations in some datasets. The excluded datasets are CNN Daily Mail, XLEL-WD, and SODA.
提供机构:
ali-issa



