P-FOLIO

# P-FOLIO: Evaluating and Improving Logical Reasoning with Abundant Human-Written Reasoning Chains
[WIP]: We are working on the release of the dataset. Feel free to send us an [email]([e-mail]) to stay in touch!

[P-FOLIO](https://aclanthology.org/2024.findings-emnlp.966) is a human-annotated dataset consisting of diverse and complex reasoning chains for a set of realistic logical reasoning stories also written by humans. P-FOLIO is collected with an annotation protocol that facilitates humans to annotate well-structured natural language proofs for first-order logic reasoning problems in a step-by-step manner.
P-FOLIO is built upon [FOLIO](https://huggingface.co/datasets/yale-nlp/FOLIO).

## Citation
```
@inproceedings{han-etal-2024-p,
title = "{P}-{FOLIO}: Evaluating and Improving Logical Reasoning with Abundant Human-Written Reasoning Chains",
author = "Han, Simeng and Yu, Aaron and many other authors and Xiong, Caiming and Radev, Dragomir and Ying, Rex and Cohan, Arman",
editor = "Al-Onaizan, Yaser and Bansal, Mohit and Chen, Yun-Nung",
booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2024",
month = nov,
year = "2024",
address = "Miami, Florida, USA",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2024.findings-emnlp.966",
pages = "16553--16565",
}
```

# P-FOLIO：基于丰富人工撰写推理链的逻辑推理评估与改进
[工作进行中]：本数据集的发布工作正在推进中，欢迎致信[e-mail]保持联络！

[P-FOLIO](https://aclanthology.org/2024.findings-emnlp.966) 是一款经人工标注的数据集，包含一系列由人工创作的现实逻辑推理故事对应的多样化且复杂的推理链。P-FOLIO 的构建采用了一套标注规范，可支持人工以分步方式为一阶逻辑（first-order logic）推理问题标注结构严谨的自然语言证明。

本数据集基于[FOLIO](https://huggingface.co/datasets/yale-nlp/FOLIO)构建。

## 引用

@inproceedings{han-etal-2024-p,
title = "{P}-{FOLIO}：基于丰富人工撰写推理链的逻辑推理评估与改进",
author = "韩思萌 与 亚伦·于 及其他多位作者 与 熊才明 与 德拉戈米尔·拉德夫 与 雷克斯·应 与 阿尔曼·科恩",
editor = "亚塞尔·阿尔-奥奈赞 与 莫希特·班萨尔 与 陈允宁",
booktitle = "《计算语言学协会研究发现：2024年自然语言处理经验方法会议（EMNLP 2024）》",
month = "十一月",
year = 2024,
address = "美国佛罗里达州迈阿密",
publisher = "计算语言学协会",
url = "https://aclanthology.org/2024.findings-emnlp.966",
pages = "16553--16565",
}