遇见数据集

miniF2F-Graded

收藏
Zenodo2025-06-18 更新2026-05-26 收录
官方服务:

资源简介:

MiniF2F-Graded(./miniF2F-Graded.json) builds upon miniF2F by introducing additional metrics for each theorem: Difficulty, Discrimination, and Difficulty Grading. These metrics are calculated based on the actual performance of LLMs in proving the theorems, making them a more accurate reflection of difficulty from the perspective of LLMs. For a complete introduction to the work, please refer to the paper published on arxiv:Psychometric-Based Evaluation for Theorem Proving with Large Language Models

提供机构:
Zenodo
创建时间:
2025-01-31
二维码
社区交流群
二维码
科研交流群
商业服务