NickyNicky/aya_dataset_multilingual_chatml_gemma_response_json_V2
收藏Hugging Face2024-02-29 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/NickyNicky/aya_dataset_multilingual_chatml_gemma_response_json_V2
下载链接
链接失效反馈官方服务:
资源简介:
---
dataset_info:
features:
- name: text
dtype: string
- name: len_tokens
dtype: int64
splits:
- name: train
num_bytes: 125135821
num_examples: 135004
download_size: 24806994
dataset_size: 125135821
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
datasets:
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext1
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext2
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext3
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext4
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext5
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext6
# - NickyNicky/aya_dataset_multilingual_inputs_targets_ext7
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext8
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext9
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext10
language:
- es
- fr
- en
- de
---
#tokenizer: google/gemma-2b-it
```
datasets:
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext1
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext2
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext3
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext4
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext5
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext6
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext8
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext9
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext10
```
```
# FORMAT EXAMPLE
<bos><start_of_turn>system
You are a helpful AI assistant.
solo responde en formato json.
lista de codigos linguisticos disponibles: ["es", "es"].<end_of_turn>
<start_of_turn>user
{
"input": "es",
"targets": "es",
"inputs_text": "¿Qué presidente de los Estados Unidos nunca se ha casado?",
}<end_of_turn>
<start_of_turn>model
{
"targets": "es",
"targets_es": "James Buchanan es el único presidente que nunca se casó."
}<end_of_turn><eos>
```
# hist len_tokens

# describe.

# percentil.

提供机构:
NickyNicky
原始信息汇总
数据集概述
数据集特征
- 文本 (text): 数据类型为字符串。
- 令牌长度 (len_tokens): 数据类型为64位整数。
数据分割
- 训练集 (train): 包含135,004个样本,总大小为125,135,821字节。
数据集大小
- 下载大小: 24,806,994字节。
- 数据集大小: 125,135,821字节。
配置
- 默认配置 (default): 包含训练数据文件,路径为
data/train-*。
数据集列表
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext1
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext2
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext3
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext4
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext5
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext6
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext8
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext9
- NickyNicky/aya_dataset_multilingual_inputs_targets_ext10
支持语言
- 西班牙语 (es)
- 法语 (fr)
- 英语 (en)
- 德语 (de)



