m-a-p/CodeFeedback-Filtered-Instruction

---
language:
- en
pipeline_tag: text-generation
tags:
- code
license: apache-2.0
task_categories:
- question-answering
size_categories:
- 10K<n<100K
---

<h1 align="center"> OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement<h1>

<p align="center">
<img width="1000px" alt="OpenCodeInterpreter" src="https://opencodeinterpreter.github.io/static/images/figure1.png">
</p>
<p align="center">
<a href="https://opencodeinterpreter.github.io/">[🏠Homepage]</a>
|
<a href="https://github.com/OpenCodeInterpreter/OpenCodeInterpreter/">[🛠️Code]</a>
</p>
<hr>

## OpenCodeInterpreter
OpenCodeInterpreter is a family of open-source code generation systems designed to bridge the gap between large language models and advanced proprietary systems like the GPT-4 Code Interpreter. It significantly advances code generation capabilities by integrating execution and iterative refinement functionalities.

For further information and related work, refer to our paper: ["OpenCodeInterpreter: A System for Enhanced Code Generation and Execution"](https://arxiv.org/abs/2402.14658) available on arXiv.

## Dataset Description

CodeFeedback-Filtered-Instruction is a curated collection of code instruction queries extracted from four prominent open-source code instruction tuning datasets: [Magicoder-OSS-Instruct](https://huggingface.co/datasets/ise-uiuc/Magicoder-OSS-Instruct-75K), [Python code subset of ShareGPT](https://huggingface.co/datasets/ajibawa-2023/Python-Code-23k-ShareGPT), [Magicoder-Evol-Instruct](https://huggingface.co/datasets/ise-uiuc/Magicoder-Evol-Instruct-110K), and [Evol-Instruct-Code](https://huggingface.co/datasets/nickrosh/Evol-Instruct-Code-80k-v1).
Initially, 287k queries were aggregated from these datasets. To isolate the most intricate and informative instructions, a rigorous filtering process was employed.
This involved utilizing the Qwen-72B-Chat, an open-source chat model, for selective filtering.
The code queries are evaluated along with their corresponding responses within the compiled datasets by the LLM, assigning a complexity score ranging from 1 to 5, and only those rated 4 or 5 were retained for the seed set.
This meticulous filtering process resulted in a final collection of 156k high-quality single-turn code instructions.

In subsequent processing steps mentioned in the paper, besides Single-turn Packing, we exclusively utilized queries without considering responses. However, here we retained all responses to provide users with more convenient usage options.

## Contact

If you have any inquiries, please feel free to raise an issue or reach out to us via email at: [e-mail], [e-mail].
We're here to assist you!

⚠️The dataset contains part data generated by OpenAI's language models, please pay attention to OpenAI's usage policy when adopting this dataset: https://openai.com/policies/usage-policies.

---
语言：
- 英语
流水线任务类型：
- 文本生成
标签：
- 代码
许可证：
- Apache-2.0
任务类别：
- 问答
规模分类：
- 10K<n<100K
---

<h1 align="center">OpenCodeInterpreter：将代码生成与执行、迭代优化相结合</h1>

<p align="center">
<img width="1000px" alt="OpenCodeInterpreter" src="https://opencodeinterpreter.github.io/static/images/figure1.png">
</p>

<p align="center">
<a href="https://opencodeinterpreter.github.io/">[🏠主页]</a>
|
<a href="https://github.com/OpenCodeInterpreter/OpenCodeInterpreter/">[🛠️代码仓库]</a>
</p>
<hr>

## OpenCodeInterpreter
OpenCodeInterpreter是一系列开源代码生成系统，旨在弥合大语言模型（Large Language Model）与GPT-4代码解释器等先进闭源系统之间的差距。该系列通过集成代码执行与迭代优化功能，大幅提升了代码生成能力。

如需了解更多信息及相关研究，请参阅我们发表在arXiv上的论文：《OpenCodeInterpreter：面向增强代码生成与执行的系统》（https://arxiv.org/abs/2402.14658）。

## 数据集说明
CodeFeedback-Filtered-Instruction是一份经过精心筛选的代码指令查询集，其数据源自四个知名开源代码指令微调数据集：[Magicoder-OSS-Instruct](https://huggingface.co/datasets/ise-uiuc/Magicoder-OSS-Instruct-75K)、[ShareGPT的Python代码子集](https://huggingface.co/datasets/ajibawa-2023/Python-Code-23k-ShareGPT)、[Magicoder-Evol-Instruct](https://huggingface.co/datasets/ise-uiuc/Magicoder-Evol-Instruct-110K)以及[Evol-Instruct-Code](https://huggingface.co/datasets/nickrosh/Evol-Instruct-Code-80k-v1)。

最初，我们从上述数据集中汇总了28.7万条查询。为了筛选出最复杂且最具参考价值的指令，我们采用了严格的过滤流程。该流程借助开源聊天模型Qwen-72B-Chat完成选择性过滤。大语言模型会对编译后的数据集中的代码查询及其对应的回复进行评估，赋予1到5分的复杂度评分，仅保留评分4或5的条目作为种子集。经过此番细致的筛选流程，最终得到了包含15.6万条高质量单轮代码指令。

在论文中提及的后续处理步骤中，除单轮打包（Single-turn Packing）环节，我们仅使用查询内容而未考虑回复。但在本数据集中，我们保留了所有回复，以向用户提供更便捷的使用选择。

## 联系方式
如有任何疑问，欢迎提交Issue或通过以下邮箱联系我们：[e-mail]、[e-mail]。我们随时为您提供帮助！

⚠️本数据集包含部分由OpenAI语言模型生成的数据，使用本数据集时请遵守OpenAI的使用政策：https://openai.com/policies/usage-policies。

原始信息汇总

数据集概述

数据集名称

• CodeFeedback-Filtered-Instruction

数据集来源

• 该数据集是从以下四个开源代码指令调优数据集中提取的代码指令查询：
  • Magicoder-OSS-Instruct
  • Python code subset of ShareGPT
  • Magicoder-Evol-Instruct
  • Evol-Instruct-Code

数据集规模

• 初始集合包含287k查询。
• 经过筛选后，最终集合包含156k高质量的单轮代码指令。

数据集筛选过程

• 使用Qwen-72B-Chat模型进行筛选。
• 代码查询及其响应由大型语言模型（LLM）评估，根据复杂度评分（1至5）筛选，仅保留评分4或5的查询。

数据集特点

• 数据集保留了所有响应，以便用户更方便地使用。

数据集使用注意事项

• 数据集部分内容由OpenAI的语言模型生成，使用时需遵守OpenAI的使用政策。

搜集汇总

背景与挑战

背景概述

CodeFeedback-Filtered-Instruction是一个高质量代码指令数据集，包含约156k条单轮代码查询，从多个开源代码指令数据集中筛选而来，使用Qwen-72B-Chat模型评估并仅保留高复杂性评分（4或5）的条目。数据集支持多种编程语言（如Python、SQL、JavaScript），专注于代码生成和问答任务，旨在提升代码生成系统的执行和细化能力。