zh-tw-llm-dv-dv/zh-tw-llm-dev-sample-ta8k-d40d11-only_embeddings-tr_alp-69ed82-c2048

---
dataset_info:
dataset_size: 454603.0
download_size: 175001
features:
- name: input_ids
sequence: int32
- name: attention_mask
sequence: int8
- name: labels
sequence: int64
- dtype: string
name: preview
splits:
- name: train
num_bytes: 454603.0
num_examples: 300

---
# zh-tw-llm-dev-sample-ta8k-d40d11-only_embeddings-tr_alp-69ed82-c2048

This dataset is a part of the `zh-tw-llm-dev` project.

* Tokenizer: `zh-tw-llm-dev-tokenizer-a8k-d40d11`
* Built with: `translations`, `alpaca`
* Rows: `300`
* Max length: `2048`
* Full config:
```json
{"build_with": ["translations", "alpaca"], "preview_length": 256, "translations_settings": {"source_dataset": "zetavg/coct-en-zh-tw-translations-twp-300k", "lang_1_key": "en", "lang_2_key": "ch", "templates": ["English: {lang_1}\nChinese: {lang_2}", "Chinese: {lang_2}\nEnglish: {lang_1}"], "rows_limit": 100}, "alpaca_settings": {"source_dataset": "zetavg/traditional-chinese-alpaca-en-align", "template": "short", "train_on_inputs": false, "rows_limit": 100}}
```

原始信息汇总

数据集概述

基本信息

• 数据集大小: 454603.0 字节
• 下载大小: 175001 字节
• 训练集大小: 454603.0 字节
• 训练集样本数: 300

特征描述

• input_ids: 序列类型为 int32
• attention_mask: 序列类型为 int8
• labels: 序列类型为 int64
• preview: 数据类型为 string

数据集结构

• 分片信息:
  • 名称: train
  • 字节数: 454603.0
  • 样本数: 300