sawradip/bn-translation-mega-raw-noisy

---
dataset_info:
features:
- name: bn_raw
dtype: string
- name: en_raw
dtype: string
splits:
- name: alt
num_bytes: 10242909
num_examples: 20106
- name: amadercat
num_bytes: 331783
num_examples: 1781
- name: anuvaad
num_bytes: 318844740
num_examples: 1001740
- name: banglanmt
num_bytes: 680601914
num_examples: 2659723
- name: ptb
num_bytes: 659453
num_examples: 1313
- name: ilmpc
num_bytes: 39492292
num_examples: 324366
- name: xlent
num_bytes: 111488860
num_examples: 1616537
- name: nllb
num_bytes: 11409482018
num_examples: 62006746
- name: google
num_bytes: 37571933
num_examples: 191426
- name: bpcc_daily
num_bytes: 1462271
num_examples: 8458
- name: bpcc_icli
num_bytes: 43821553
num_examples: 123766
- name: bpcc_massive
num_bytes: 2233668
num_examples: 16492
- name: bpcc_nllb
num_bytes: 2572847096
num_examples: 13580532
- name: bpcc_samantar_v1
num_bytes: 889529481
num_examples: 2946291
- name: bpcc_samantar_v2
num_bytes: 2549472317
num_examples: 16055075
- name: bpcc_wiki
num_bytes: 18726914
num_examples: 47994
download_size: 9530806631
dataset_size: 18686809202
configs:
- config_name: default
data_files:
- split: alt
path: data/alt-*
- split: amadercat
path: data/amadercat-*
- split: anuvaad
path: data/anuvaad-*
- split: banglanmt
path: data/banglanmt-*
- split: ptb
path: data/ptb-*
- split: ilmpc
path: data/ilmpc-*
- split: xlent
path: data/xlent-*
- split: nllb
path: data/nllb-*
- split: google
path: data/google-*
- split: bpcc_daily
path: data/bpcc_daily-*
- split: bpcc_icli
path: data/bpcc_icli-*
- split: bpcc_massive
path: data/bpcc_massive-*
- split: bpcc_nllb
path: data/bpcc_nllb-*
- split: bpcc_samantar_v1
path: data/bpcc_samantar_v1-*
- split: bpcc_samantar_v2
path: data/bpcc_samantar_v2-*
- split: bpcc_wiki
path: data/bpcc_wiki-*
---

原始信息汇总

数据集概述

数据集特征

• bn_raw: 数据类型为字符串
• en_raw: 数据类型为字符串

数据集分割

• alt: 20,106个样本，大小为10,242,909字节
• amadercat: 1,781个样本，大小为331,783字节
• anuvaad: 1,001,740个样本，大小为318,844,740字节
• banglanmt: 2,659,723个样本，大小为680,601,914字节
• ptb: 1,313个样本，大小为659,453字节
• ilmpc: 324,366个样本，大小为39,492,292字节
• xlent: 1,616,537个样本，大小为111,488,860字节
• nllb: 62,006,746个样本，大小为11,409,482,018字节
• google: 191,426个样本，大小为37,571,933字节
• bpcc_daily: 8,458个样本，大小为1,462,271字节
• bpcc_icli: 123,766个样本，大小为43,821,553字节
• bpcc_massive: 16,492个样本，大小为2,233,668字节
• bpcc_nllb: 13,580,532个样本，大小为2,572,847,096字节
• bpcc_samantar_v1: 2,946,291个样本，大小为889,529,481字节
• bpcc_samantar_v2: 16,055,075个样本，大小为2,549,472,317字节
• bpcc_wiki: 47,994个样本，大小为18,726,914字节

数据集大小

• 下载大小: 9,530,806,631字节
• 数据集总大小: 18,686,809,202字节

配置文件

• config_name: default
• data_files: 包含多个分割的数据文件路径