heegyu/ko-openchat-0404

---
dataset_info:
features:
- name: conversations
list:
- name: content
dtype: string
- name: role
dtype: string
- name: source
dtype: string
splits:
- name: train
num_bytes: 3742331042.3631973
num_examples: 1854960
- name: test
num_bytes: 2017472.6368025173
num_examples: 1000
download_size: 1924826936
dataset_size: 3744348515.0
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
- split: test
path: data/test-*
---

한국어 챗봇 학습을 위해, 여러 데이터를 가져와서 포멧을 통일

- [heegyu/glaive-function-calling-v2-ko](https://huggingface.co/datasets/heegyu/glaive-function-calling-v2-ko): 15170 items
- [FreedomIntelligence/evol-instruct-korean](https://huggingface.co/datasets/FreedomIntelligence/evol-instruct-korean): 59022 items
- [heegyu/PKU-SafeRLHF-ko](https://huggingface.co/datasets/heegyu/PKU-SafeRLHF-ko): 135213 items
- [maywell/koVast](https://huggingface.co/datasets/maywell/koVast): 684579 items
- [MarkrAI/KoCommercial-Dataset](https://huggingface.co/datasets/MarkrAI/KoCommercial-Dataset): 175454 items
- [HuggingFaceH4/ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k): 207865 items
- [Open-Orca/SlimOrca-Dedup](https://huggingface.co/datasets/Open-Orca/SlimOrca-Dedup): 363491 items
- [glaiveai/glaive-code-assistant-v2](https://huggingface.co/datasets/glaiveai/glaive-code-assistant-v2): 215166 items

原始信息汇总

数据集概述

数据集特征

• conversations:
  • content: 数据类型为字符串
  • role: 数据类型为字符串
• source: 数据类型为字符串

数据集分割

• train:
  • 数据量: 3742331042.3631973 字节
  • 示例数量: 1854960
• test:
  • 数据量: 2017472.6368025173 字节
  • 示例数量: 1000

数据集大小

• 下载大小: 1924826936 字节
• 数据集总大小: 3744348515.0 字节

配置文件

• config_name: default
• data_files:
  • train: 路径为 data/train-*
  • test: 路径为 data/test-*