hpprc/llmjp-kaken
收藏Hugging Face2024-12-08 更新2024-12-14 收录
下载链接:
https://hf-mirror.com/datasets/hpprc/llmjp-kaken
下载链接
链接失效反馈官方服务:
资源简介:
该数据集是将llm-jp-corpus-v3的kaken子集转换为HuggingFace格式,并从原始文章的URL中获取标题的数据集。数据集包含标题、文本、ID和URL等特征,主要用于日语文本处理。数据集的大小为5115429445字节,包含1114379个训练样本,下载大小为1899267119字节。数据集的许可证为CC-BY 4.0。
This dataset is a kaken subset of llm-jp-corpus-v3, converted to HF format, and includes four features: title, text, id, and url. The dataset is split into a training set, containing 1,114,379 samples, with a total size of 5,115,429,445 bytes. The download size of the dataset is 1,899,267,119 bytes. The datasets configuration is named default, with data file paths as data/train-*. The dataset is licensed under CC-BY 4.0 and is in Japanese. Additionally, the original article titles were retrieved from the URLs attached to each data.
提供机构:
hpprc



