huatuo_encyclopedia_qa

# Dataset Card for Huatuo_encyclopedia_qa

## Dataset Description

- **Homepage: https://www.huatuogpt.cn/**
- **Repository: https://github.com/FreedomIntelligence/HuatuoGPT**
- **Paper: https://arxiv.org/abs/2305.01526**
- **Leaderboard:**
- **Point of Contact:**

### Dataset Summary

This dataset has a total of 364,420 pieces of medical QA data, some of which have multiple questions in different ways. We extract medical QA pairs from plain texts (e.g., medical encyclopedias and medical articles). We collected 8,699 encyclopedia entries for diseases and 2,736 encyclopedia entries for medicines on Chinese Wikipedia. Moreover, we crawled 226,432 high-quality medical articles from the Qianwen Health website.

## Dataset Creation

### Source Data

https://zh.wikipedia.org/wiki/

https://51zyzy.com/

## Citation

```
@misc{li2023huatuo26m,
title={Huatuo-26M, a Large-scale Chinese Medical QA Dataset},
author={Jianquan Li and Xidong Wang and Xiangbo Wu and Zhiyi Zhang and Xiaolong Xu and Jie Fu and Prayag Tiwari and Xiang Wan and Benyou Wang},
year={2023},
eprint={2305.01526},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```

# 华佗百科问答（Huatuo_encyclopedia_qa）数据集卡片

## 数据集说明

- **主页：https://www.huatuogpt.cn/**
- **代码仓库：https://github.com/FreedomIntelligence/HuatuoGPT**
- **相关论文：https://arxiv.org/abs/2305.01526**
- **排行榜：**
- **联系方式：**

### 数据集概览

本数据集共计包含364420条医疗问答（Question Answering, QA）数据，其中部分数据包含多种表述形式的同类问题。我们从纯文本素材（如医学百科、医学文章）中提取医疗问答对。我们从中文维基百科中采集了8699条疾病百科条目与2736条药品百科条目。此外，我们从千问健康（Qianwen Health）网站爬取了226432篇高质量医学文章。

## 数据集构建

### 原始数据来源

https://zh.wikipedia.org/wiki/
https://51zyzy.com/

## 引用

@misc{li2023huatuo26m,
title={Huatuo-26M, a Large-scale Chinese Medical QA Dataset},
author={Jianquan Li and Xidong Wang and Xiangbo Wu and Zhiyi Zhang and Xiaolong Xu and Jie Fu and Prayag Tiwari and Xiang Wan and Benyou Wang},
year={2023},
eprint={2305.01526},
archivePrefix={arXiv},
primaryClass={cs.CL}
}

搜集汇总

背景与挑战

背景概述

huatuo_encyclopedia_qa数据集包含364,420条医疗问答数据，涵盖疾病和药物的百科全书条目以及高质量医疗文章。数据来源于中文维基百科和钱问健康网站，旨在支持医疗领域的自然语言处理研究。