rasdani/cohere-wikipedia-2023-11-hi-queries

---
size_categories: n<1K
dataset_info:
features:
- name: _id
dtype: string
- name: url
dtype: string
- name: title
dtype: string
- name: text
dtype: string
- name: score
dtype: float64
- name: views
dtype: float64
- name: model_name
dtype: string
- name: query
dtype: string
splits:
- name: train
num_bytes: 2084027
num_examples: 1500
download_size: 858171
dataset_size: 2084027
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
tags:
- synthetic
- distilabel
- rlaif
---

<p align="left">
<a href="https://github.com/argilla-io/distilabel">
<img src="https://raw.githubusercontent.com/argilla-io/distilabel/main/docs/assets/distilabel-badge-light.png" alt="Built with Distilabel" width="200" height="32"/>
</a>
</p>

# Dataset Card for cohere-wikipedia-2023-11-hi-queries

This dataset has been created with [distilabel](https://distilabel.argilla.io/).

## Dataset Summary

This dataset contains a `pipeline.yaml` which can be used to reproduce the pipeline that generated it in distilabel using the `distilabel` CLI:

```console
distilabel pipeline run --config "https://huggingface.co/datasets/rasdani/cohere-wikipedia-2023-11-hi-queries/raw/main/pipeline.yaml"
```

or explore the configuration:

```console
distilabel pipeline info --config "https://huggingface.co/datasets/rasdani/cohere-wikipedia-2023-11-hi-queries/raw/main/pipeline.yaml"
```

## Dataset structure

The examples have the following structure per configuration:

<details><summary> Configuration: default </summary><hr>

```json
{
"_id": "20231101.hi_215946_23",
"model_name": "gpt-4o",
"query": "\u0930\u093e\u0907\u092b\u0948\u092e\u094d\u092a\u093f\u0938\u093f\u0928 (rifampicin) \u0915\u0940 \u0916\u0941\u0930\u093e\u0915 \u0915\u0941\u0937\u094d\u0920\u0930\u094b\u0917 \u0915\u0947 \u092e\u093e\u092e\u0932\u094b\u0902 \u0915\u094b \u0915\u093f\u0924\u0928\u0947 \u092a\u094d\u0930\u0924\u093f\u0936\u0924 \u0924\u0915 \u0915\u092e \u0915\u0930 \u0938\u0915\u0924\u0940 \u0939\u0948?",
"score": 1.0,
"text": "\u0939\u093e\u0932\u093f\u092f\u093e \u092a\u0930\u0940\u0915\u094d\u0937\u0923\u094b\u0902 \u092e\u0947\u0902, \u0930\u093e\u0907\u092b\u0948\u092e\u094d\u092a\u093f\u0938\u093f\u0928 (rifampicin) \u0915\u0940 \u090f\u0915\u0932 \u0916\u0941\u0930\u093e\u0915 \u0928\u0947 \u092c\u0940\u092e\u093e\u0930\u0940 \u0938\u0947 \u0938\u0902\u092a\u0930\u094d\u0915 \u0915\u0947 \u0926\u094b \u0935\u0930\u094d\u0937 \u092c\u093e\u0926 \u0915\u0941\u0937\u094d\u0920\u0930\u094b\u0917 \u0935\u093f\u0915\u0938\u093f\u0924 \u0939\u094b\u0928\u0947 \u0915\u0940 \u0926\u0930 \u0915\u094b 57% \u0915\u092e \u0915\u0930 \u0926\u093f\u092f\u093e; \u0907\u0938 \u0905\u0935\u0927\u093f \u092e\u0947\u0902 \u0930\u093e\u0907\u092b\u0948\u092e\u094d\u092a\u093f\u0938\u093f\u0928 (rifampicin) \u0915\u0947 \u0938\u093e\u0925 \u0915\u093f\u092f\u0947 \u0917\u092f\u0947 265 \u0909\u092a\u091a\u093e\u0930\u094b\u0902 \u0928\u0947 \u0915\u0941\u0937\u094d\u0920\u0930\u094b\u0917 \u0915\u0947 \u090f\u0915 \u092e\u093e\u092e\u0932\u0947 \u0915\u094b \u0930\u094b\u0915\u093e. \u090f\u0915 \u0917\u0948\u0930-\u092f\u093e\u0926\u0943\u091a\u094d\u091b\u093f\u0915\u0943\u0924 \u0905\u0927\u094d\u092f\u092f\u0928 \u092e\u0947\u0902 \u092a\u093e\u092f\u093e \u0917\u092f\u093e \u0915\u093f \u0930\u093e\u0907\u092b\u0948\u092e\u094d\u092a\u093f\u0938\u093f\u0928 (rifampicin) \u0924\u0940\u0928 \u0935\u0930\u094d\u0937 \u092c\u093e\u0926 \u0915\u0941\u0937\u094d\u0920\u0930\u094b\u0917 \u0915\u0947 \u0928\u092f\u0947 \u092e\u093e\u092e\u0932\u094b \u0915\u0940 \u0938\u0902\u0916\u094d\u092f\u093e 75% \u0918\u091f\u093e \u0926\u0940.",
"title": "\u0915\u0941\u0937\u094d\u0920\u0930\u094b\u0917",
"url": "https://hi.wikipedia.org/wiki/%E0%A4%95%E0%A5%81%E0%A4%B7%E0%A5%8D%E0%A4%A0%E0%A4%B0%E0%A5%8B%E0%A4%97",
"views": 6169.143907526629
}
```

This subset can be loaded as:

```python
from datasets import load_dataset

ds = load_dataset("rasdani/cohere-wikipedia-2023-11-hi-queries", "default")
```

Or simply as it follows, since there's only one configuration and is named `default`:

```python
from datasets import load_dataset

ds = load_dataset("rasdani/cohere-wikipedia-2023-11-hi-queries")
```

</details>

原始信息汇总

数据集概述

名称: cohere-wikipedia-2023-11-hi-queries

大小:

• 训练集大小: 2084027 字节
• 训练集示例数: 1500
• 下载大小: 858171 字节

特征:

• _id: 字符串类型
• url: 字符串类型
• title: 字符串类型
• text: 字符串类型
• score: 浮点数类型
• views: 浮点数类型
• model_name: 字符串类型
• query: 字符串类型

配置:

• 默认配置
  • 数据文件路径: data/train-*

标签:

• synthetic
• distilabel
• rlaif

数据集结构

默认配置结构: json { "_id": "字符串", "model_name": "字符串", "query": "字符串", "score": 浮点数, "text": "字符串", "title": "字符串", "url": "字符串", "views": 浮点数 }

加载数据集: python from datasets import load_dataset

ds = load_dataset("rasdani/cohere-wikipedia-2023-11-hi-queries")