nayohan/raw_translate_corpus_uniform

---
dataset_info:
features:
- name: english
dtype: string
- name: korean
dtype: string
- name: from
dtype: string
- name: category
dtype: string
splits:
- name: train
num_bytes: 1307509048.0
num_examples: 357109
download_size: 746195271
dataset_size: 1307509048.0
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---
# 10개의 명령어(영어-한국어) 병렬 데이터셋 통합 | (357k)

- [jhflow/orca_ko_en_pair](https://huggingface.co/datasets/jhflow/orca_ko_en_pair) | qeustion, output | 19k *2 = 38k
- [jhflow/platypus_ko_en_pair](https://huggingface.co/datasets/jhflow/platypus_ko_en_pair) | insturction_ko, output_ko | 24k * 2 = 48k
- [jhflow/dolly_ko_en_pair](https://huggingface.co/datasets/jhflow/dolly_ko_en_pair) | instruction, context, response | 15k * 3 = 45k
- [heegyu/OIG-small-chip2-ko](https://huggingface.co/datasets/heegyu/OIG-small-chip2-ko) | user_translated, chip_translated | 210k * 2 % 10 = 42k
- [lemon-mint/en_ko_translation_purified_v0.1](https://huggingface.co/datasets/lemon-mint/en_ko_translation_purified_v0.1) | korean | 1.4k
- [squarelike/sharegpt_deepl_ko_translation](https://huggingface.co/datasets/squarelike/sharegpt_deepl_ko_translation) | korean | 486k % 10 = 48k
- [nayohan/aihub-en-ko-translation-1.2m](https://huggingface.co/datasets/nayohan/aihub-en-ko-translation-1.2m) | 1200k % 25 = 48k
- [amphora/parallel-wiki-koen](https://huggingface.co/datasets/amphora/parallel-wiki-koen) | text_ko | 30k
- [kuotient/gsm8k-ko](https://huggingface.co/datasets/kuotient/gsm8k-ko) | question, answer | 8k * 2 = 16k
- [kuotient/orca-math-word-problems-193k-korean](https://huggingface.co/datasets/kuotient/orca-math-word-problems-193k-korean) | question, answer | 193k *2 % 10 = 38k

**Special Thanks to [jhflow](https://huggingface.co/jhflow), [heegyu](https://huggingface.co/heegyu), [lemon-mint](https://huggingface.co/lemon-mint), [squarelike](https://huggingface.co/squarelike), [kuotient](https://huggingface.co/kuotient).**

原始信息汇总

数据集概述

数据集特征

• english: 数据类型为字符串
• korean: 数据类型为字符串
• from: 数据类型为字符串
• category: 数据类型为字符串

数据集划分

• train:
  • 数据量: 1307509048.0 字节
  • 示例数量: 357109

数据集大小

• 下载大小: 746195271 字节
• 数据集大小: 1307509048.0 字节

配置

• default:
  • 数据文件路径: data/train-*