BASF-AI/ChemHotpotQARetrieval

---
dataset_info:
- config_name: corpus
features:
- name: _id
dtype: string
- name: title
dtype: string
- name: text
dtype: string
splits:
- name: corpus
num_bytes: 3119377.729206591
num_examples: 10069
download_size: 2724264
dataset_size: 3119377.729206591
- config_name: default
features:
- name: query-id
dtype: string
- name: corpus-id
dtype: string
- name: score
dtype: float64
splits:
- name: train
num_bytes: 8786.2599
num_examples: 187
- name: dev
num_bytes: 376
num_examples: 8
- name: test
num_bytes: 845.3120864280892
num_examples: 18
download_size: 11033
dataset_size: 10007.571986428089
- config_name: queries
features:
- name: _id
dtype: string
- name: text
dtype: string
splits:
- name: queries
num_bytes: 28143.16582185341
num_examples: 206
download_size: 21864
dataset_size: 28143.16582185341
configs:
- config_name: corpus
data_files:
- split: corpus
path: corpus/corpus-*
- config_name: default
data_files:
- split: train
path: data/train-*
- split: dev
path: data/dev-*
- split: test
path: data/test-*
- config_name: queries
data_files:
- split: queries
path: queries/queries-*
task_categories:
- question-answering
language:
- en
tags:
- chemistry
- wikipedia
- hotpotqa
- chemteb
pretty_name: Chemical HotpotQA
license: cc-by-nc-sa-4.0
size_categories:
- 10K<n<100K
---
# Chemical HotpotQA
This dataset is created from the [mteb/hotpotqa](https://huggingface.co/datasets/mteb/hotpotqa) dataset on Hugging Face. [HotpotQA](https://hotpotqa.github.io/) is a multi-hop question answering dataset collected from the English Wikipedia. For this chemistry-specific subset, we filtered queries related to chemistry by starting from the chemistry category in Wikipedia and traversing up to three levels deep in linked articles. This method allowed us to focus on chemistry-related questions, creating a specialized subset of the original dataset for domain-specific tasks.