openGPT-X/arcx

### Citation Information

If you find benchmarks useful in your research, please consider citing the test and also the [ARC](https://arxiv.org/abs/1803.05457) dataset it draws from:

```
@misc{thellmann2024crosslingual,
title={Towards Cross-Lingual LLM Evaluation for European Languages},
author={Klaudia Thellmann and Bernhard Stadler and Michael Fromm and Jasper Schulze Buschhoff and Alex Jude and Fabio Barth and Johannes Leveling and Nicolas Flores-Herr and Joachim Köhler and René Jäkel and Mehdi Ali},
year={2024},
eprint={2410.08928},
archivePrefix={arXiv},
primaryClass={cs.CL}

@article{clark-2018-arc,
author = {Peter Clark and
Isaac Cowhey and
Oren Etzioni and
Tushar Khot and
Ashish Sabharwal and
Carissa Schoenick and
Oyvind Tafjord},
title = {Think you have Solved Question Answering? Try ARC, the {AI2} Reasoning
Challenge},
journal = {CoRR},
volume = {abs/1803.05457},
year = {2018},
url = {http://arxiv.org/abs/1803.05457},
eprinttype = {arXiv},
eprint = {1803.05457},
timestamp = {Mon, 13 Aug 2018 16:48:43 +0200},
biburl = {https://dblp.org/rec/journals/corr/abs-1803-05457.bib},
bibsource = {dblp computer science bibliography, https://dblp.org}
}
}
```