RoCar Evaluation Tasks
收藏arXiv2025-09-30 收录
下载链接:
https://github.com/NEU-DataMining/RoCar
下载链接
链接失效反馈官方服务:
资源简介:
该数据集基于随机生成的任务图谱构建了一系列评估任务,旨在评估大型语言模型在推理和记忆能力方面的表现。数据集包含了不同距离的推理能力评估任务,以及设计用于在多个步骤中测试记忆能力的任务。总的来说,该数据集的任务旨在对大型语言模型的推理和记忆能力进行综合评估。
This dataset constructs a series of evaluation tasks based on randomly generated task graphs, aiming to assess the reasoning and memory capabilities of Large Language Models (LLMs). The dataset includes reasoning evaluation tasks with varying distances, as well as tasks designed to test memory over multiple steps. Overall, the tasks in this dataset are intended to comprehensively evaluate the reasoning and memory capabilities of Large Language Models (LLMs).
提供机构:
NEU Data Mining



