MatinaAI/persian_arc

---
language:
- en
- fa
license: cc-by-sa-4.0
multilinguality:
- multilingual
size_categories:
- 1K<n<10K
task_categories:
- question-answering
task_ids:
- open-domain-qa
- multiple-choice-qa
pretty_name: PersianARC
dataset_info:
- config_name: ARC-Challenge
features:
- name: id
dtype: string
- name: question_fa
dtype: string
- name: question
dtype: string
- name: choices
struct:
- name: label
sequence: string
- name: text
sequence: string
- name: text_fa
sequence: string
- name: answerKey
dtype: string
splits:
- name: train
num_bytes: 832175
num_examples: 1119
- name: test
num_bytes: 896712
num_examples: 1172
- name: validation
num_bytes: 229416
num_examples: 299
download_size: 992395
dataset_size: 1958303
- config_name: ARC-Easy
features:
- name: id
dtype: string
- name: question_fa
dtype: string
- name: question
dtype: string
- name: choices
struct:
- name: label
sequence: string
- name: text
sequence: string
- name: text_fa
sequence: string
- name: answerKey
dtype: string
splits:
- name: train
num_bytes: 1445515
num_examples: 2251
- name: test
num_bytes: 1535948
num_examples: 2376
- name: validation
num_bytes: 368574
num_examples: 570
download_size: 1675003
dataset_size: 3350037
configs:
- config_name: ARC-Challenge
data_files:
- split: train
path: ARC-Challenge/train-*
- split: test
path: ARC-Challenge/test-*
- split: validation
path: ARC-Challenge/validation-*
- config_name: ARC-Easy
data_files:
- split: train
path: ARC-Easy/train-*
- split: test
path: ARC-Easy/test-*
- split: validation
path: ARC-Easy/validation-*
---

# Dataset Card for persian_arc

<!-- Provide a quick summary of the dataset. -->

This dataset is the persian version of [allenai/ai2_arc](https://huggingface.co/datasets/allenai/ai2_arc) translated by GPT-4o.

## Table of Contents
- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-fields)
- [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Dataset Curators](#dataset-curators)
- [Licensing Information](#licensing-information)
- [Citation Information](#citation-information)
- [Contributions](#contributions)

## Original Dataset Description

### Supported Tasks and Leaderboards

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Languages

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Dataset Structure

### Data Instances

#### ARC-Challenge

An example of 'train' looks as follows.
```
{
'id': 'Mercury_SC_415702',
'question_fa': 'جرج می\u200cخواهد با مالیدن دست\u200cهایش به سرعت آن\u200cها را گرم کند. کدام سطح پوست بیشترین گرما را تولید می\u200cکند؟',
'question': 'George wants to warm his hands quickly by rubbing them. Which skin surface will produce the most heat?',
'choices': {
'label': ['A', 'B', 'C', 'D'],
'text': ['dry palms',
'wet palms',
'palms covered with oil',
'palms covered with lotion'],
'text_fa': [' کف دست\u200cهای خشک',
' کف دست\u200cهای خیس',
' کف دست\u200cهای پوشیده از روغن',
' کف دست\u200cهای پوشیده از لوسیون']
},
'answerKey': 'A'
}
```

#### ARC-Easy

An example of 'train' looks as follows.
```
{
'id': 'Mercury_7220990',
'question_fa': 'کدام عامل به احتمال زیاد باعث تب در یک فرد می\u200cشود؟',
'question': 'Which factor will most likely cause a person to develop a fever?',
'choices': {'label': ['A', 'B', 'C', 'D'],
'text': ['a leg muscle relaxing after exercise',
'a bacterial population in the bloodstream',
'several viral particles on the skin',
'carbohydrates being digested in the stomach'],
'text_fa': [' آرام شدن عضلات پا بعد از ورزش',
' جمعیت باکتریایی در جریان خون',
' چند ذره ویروسی روی پوست',
' هضم کربوهیدرات ها در معده']
},
'answerKey': 'B'
}
```

### Data Fields

The data fields are the same among all splits.

#### ARC-Challenge
- `id`: a `string` feature.
- `question`: a `string` feature.
- `question_fa`: a `string` feature.
- `choices`: a dictionary feature containing:
- `text`: a `string` feature.
- `text_fa`: a `string` feature.
- `label`: a `string` feature.
- `answerKey`: a `string` feature.

#### ARC-Easy
- `id`: a `string` feature.
- `question`: a `string` feature.
- `question_fa`: a `string` feature.
- `choices`: a dictionary feature containing:
- `text`: a `string` feature.
- `text_fa`: a `string` feature
- `label`: a `string` feature.
- `answerKey`: a `string` feature.

### Data Splits

| name |train|validation|test|
|-------------|----:|---------:|---:|
|ARC-Challenge| 1119| 299|1172|
|ARC-Easy | 2251| 570|2376|

## Dataset Creation

### Curation Rationale

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the source language producers?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Annotations

#### Annotation process

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the annotators?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Personal and Sensitive Information

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Discussion of Biases

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Other Known Limitations

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Additional Information