shi3z/ja_conv_wikipedia_llama2pro8b_30k
收藏Hugging Face2024-01-21 更新2024-03-04 收录
下载链接：
https://hf-mirror.com/datasets/shi3z/ja_conv_wikipedia_llama2pro8b_30k
下载链接
链接失效反馈官方服务：
资源简介：
---
license: llama2
task_categories:
- conversational
language:
- ja
size_categories:
- 10K<n<100K
---
This dataset is based on the Japanese version of Wikipedia dataset and converted into a multi-turn conversation format using llama2Pro8B.
Since it is a llama2 license, it can be used commercially for services.
Some strange dialogue may be included as it has not been screened by humans.
We generated over 80,000 conversations 22 days on an A100 80GBx7 machine and automatically screened them.
# Model
https://huggingface.co/spaces/TencentARC/LLaMA-Pro-8B-Instruct-Chat
# Dataset
https://huggingface.co/datasets/izumi-lab/wikipedia-ja-20230720
# Compute by
Tsuginosuke AI SuperComputer
FreeAI Ltd.
https://free-ai.ltd
提供机构：
shi3z
原始信息汇总
数据集概述
许可证
- 许可证类型：llama2
任务类别
- 对话型
语言
- 日语
数据规模
- 数据量：10K<n<100K
数据来源与处理
- 数据集基于日文版Wikipedia数据集，通过llama2Pro8B转换为多轮对话格式。
- 数据集包含可能未经人工筛选的异常对话。
- 数据集在A100 80GBx7机器上生成，历时22天，生成了超过80,000条对话，并进行了自动筛选。
相关链接
计算资源
- 计算资源提供方：Tsuginosuke AI SuperComputer
- 公司：FreeAI Ltd.
