Mutonix/RefGPT-Code-ds

---
license: apache-2.0
dataset_info:
features:
- name: dialogue
dtype: string
- name: reference
dtype: string
- name: language
dtype: string
- name: type
dtype: string
splits:
- name: en
num_bytes: 190813718.0874176
num_examples: 13948
- name: zh
num_bytes: 180002282.0268779
num_examples: 14124
download_size: 166204685
dataset_size: 370816000.1142955
task_categories:
- conversational
language:
- zh
- en
arxiv: https://arxiv.org/abs/2305.14994
size_categories:
- 10K<n<100K
---
# Dataset Card for RefGPT-Code-ds

## Dataset Description

- **Homepage:**
- **Repository:** [https://github.com/ziliwangnlp/RefGPT](https://github.com/ziliwangnlp/RefGPT)
- **Paper:** [https://arxiv.org/abs/2305.14994](https://arxiv.org/abs/2305.14994)
- **Leaderboard:**
- **Point of Contact:**

### Dataset Summary
<p align="center">
<a href="https://arxiv.org/abs/2305.14994"><b>[Paper] RefGPT</b></a> |
<a href="https://github.com/ziliwangnlp/RefGPT"><b>[Github] RefGPT</b></a>
</p>

RefGPT-Code is a dataset containing 76k multi-turn dialogues about programming with 37k English and 39k Chinese, which has covered most aspects of code usage scenarios and multiple types of programming languages. Both the English version and Chinese version use the public GitHub dataset on Google BiqQuery with no overlap in these two languages. RefGPT-Code has derived various ways of leveraging the program code as the reference to enable different scenarios. We consider three perspectives of code discussion, code creation and bug fixing in RefGPT-Code.

**RefGPT-Code-ds** is the "code discussion" subset. <font color=red>It has the reference added to the first question of the user between the "\<context\>" and "\</context\>" labels.</font>

### Supported Tasks and Leaderboards

Chatbot instruction finetuning

### Languages

Chinese, English

## Dataset Structure

### Data Instances

[More Information Needed]

### Data Fields

[More Information Needed]

### Data Splits

[More Information Needed]

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

Please pay attention that RefGPT Datasets, including RefGPT-Fact and RefGPT-Code, have not undergone manual verification, and as such, their security cannot be strictly guaranteed. Users should be aware that they are responsible for the results generated using this data.

### Discussion of Biases

As the datasets RefGPT-Fact and RefGPT-Code are collected by using the references like Wikipedia and Github repositories, it can not be avoided that the reference itself has factual errors, typos, or bugs and malicious code if it is from Github repositories. The datasets may also reflect the biases of the selected references and GPT-3.5/GPT-4 model

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

[More Information Needed]

### Citation Information

```bibtex
@misc{yang2023refgpt,
title={RefGPT: Reference -> Truthful & Customized Dialogues Generation by GPTs and for GPTs},
author={Dongjie Yang and Ruifeng Yuan and YuanTao Fan and YiFei Yang and Zili Wang and Shusen Wang and Hai Zhao},
year={2023},
eprint={2305.14994},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```

### Contributions

[More Information Needed]

原始信息汇总

数据集概述

名称： RefGPT-Code-ds

描述： RefGPT-Code-ds 是 RefGPT-Code 数据集的一个子集，专注于“代码讨论”。该子集在用户的首个问题中添加了参考信息，这些信息位于 "<context>" 和 "</context>" 标签之间。

语言： 中文, 英文

数据集大小：

• 下载大小： 166204685 字节
• 数据集大小： 370816000.1142955 字节

数据集结构：

• 特征：
  • dialogue: 字符串
  • reference: 字符串
  • language: 字符串
  • type: 字符串
• 分割：
  • en: 13948 个示例，190813718.0874176 字节
  • zh: 14124 个示例，180002282.0268779 字节

任务类别： 对话

许可证： Apache-2.0

数据集限制：

• 数据集未经过手动验证，安全性无法严格保证。
• 数据可能包含参考来源的错误、拼写错误或恶意代码。
• 数据可能反映所选参考和 GPT-3.5/GPT-4 模型的偏见。

使用注意事项：

• 用户应负责使用此数据集产生的任何结果。