vwxyzjn/ultrachat_200k_filtered_1708035667

---
dataset_info:
features:
- name: prompt
dtype: string
- name: prompt_id
dtype: string
- name: messages
list:
- name: content
dtype: string
- name: role
dtype: string
- name: query
list:
- name: content
dtype: string
- name: role
dtype: string
- name: query_token
sequence: int64
- name: query_reference_response
list:
- name: content
dtype: string
- name: role
dtype: string
- name: query_reference_response_token
sequence: int64
- name: query_reference_response_token_len
dtype: int64
- name: query_token_len
dtype: int64
- name: reference_response
struct:
- name: content
dtype: string
- name: role
dtype: string
- name: reference_response_token
sequence: int64
- name: reference_response_token_len
dtype: int64
splits:
- name: test_sft
num_bytes: 1982888370.9168758
num_examples: 22991
- name: train_sft
num_bytes: 17846869528.524822
num_examples: 206698
download_size: 3301659997
dataset_size: 19829757899.441696
---
# Args

```python
{'base_model': 'mistralai/Mistral-7B-v0.1',
'check_length_correctness': True,
'debug': False,
'hf_entity': 'vwxyzjn',
'params': TaskQueryHParams(length=3000,
format_str='SUBREDDIT: r/{subreddit}\n'
'\n'
'TITLE: {title}\n'
'\n'
'POST: {post}\n'
'\n'
'TL;DR:',
truncate_field='post',
truncate_text='\n',
padding='pad_token',
pad_token=[32000],
pad_side='left',
max_query_length=3000,
max_sft_query_response_length=4000,
max_sft_response_length=1500,
max_rm_query_response_length=4500,
max_rm_response_length=1500),
'push_to_hub': True}
```

This dataset is primarily used for natural language processing tasks, containing multiple features such as prompt, prompt_id, messages, query, etc. Each feature has its specific data type, such as string or integer sequence. The dataset is divided into multiple splits, including test_sft and train_sft, each with its byte count and number of examples. The total size and download size of the dataset are 19829757899.441696 bytes and 3301659997 bytes, respectively.

原始信息汇总

数据集概述

数据集特征

• prompt: 字符串类型
• prompt_id: 字符串类型
• messages: 列表类型，包含以下字段：
  • content: 字符串类型
  • role: 字符串类型
• query: 列表类型，包含以下字段：
  • content: 字符串类型
  • role: 字符串类型
• query_token: 整数序列类型
• query_reference_response: 列表类型，包含以下字段：
  • content: 字符串类型
  • role: 字符串类型
• query_reference_response_token: 整数序列类型
• query_reference_response_token_len: 整数类型
• query_token_len: 整数类型
• reference_response: 结构体类型，包含以下字段：
  • content: 字符串类型
  • role: 字符串类型
• reference_response_token: 整数序列类型
• reference_response_token_len: 整数类型

数据集分割

• test_sft:
  • 字节数: 1982888370.9168758
  • 样本数: 22991
• train_sft:
  • 字节数: 17846869528.524822
  • 样本数: 206698

数据集大小

• 下载大小: 3301659997 字节
• 数据集大小: 19829757899.441696 字节