ABSPYRAMID
收藏arXiv2024-04-02 更新2024-06-21 收录
下载链接：
https://github.com/HKUST-KnowComp/AbsPyramid
下载链接
链接失效反馈官方服务：
资源简介：
ABSPYRAMID数据集由香港科技大学计算机科学与工程系创建，包含221,000个文本描述，用于评估语言模型在处理开放域事件时的抽象能力。数据集通过从ASER事件图谱中抽取事件描述，并使用WordNet和大型语言模型来收集抽象概念。该数据集涵盖了事件的三个组成部分：名词、动词和事件整体，旨在全面评估语言模型的抽象能力，并解决现有资源仅限于简化事件或特定领域的局限性。
The ABSPYRAMID dataset was created by the Department of Computer Science and Engineering at the Hong Kong University of Science and Technology, containing 221,000 text descriptions for evaluating the abstraction capability of language models when processing open-domain events. The dataset extracts event descriptions from the ASER event graph, and leverages WordNet and large language models to collect abstract concepts. It covers three core components of events: nouns, verbs, and the complete event itself, aiming to comprehensively evaluate the abstraction capability of language models and address the limitations of existing resources that are restricted to simplified events or specific domains.
提供机构：
香港科技大学计算机科学与工程系
创建时间：
2023-11-16
