OAEI-LLM数据集是由澳大利亚国立大学和莫纳什大学联合创建的，旨在评估大型语言模型（LLMs）在语义网领域中的本体匹配任务中的幻觉现象。该数据集是Ontology Alignment Evaluation Initiative (OAEI)数据集的扩展版本，包含了对LLMs在本体匹配任务中产生的幻觉进行分类和记录的新模式。数据集的创建过程包括使用LLM生成的对齐文件与原始人类标注结果进行比较，

arXiv2024-09-21 更新1540

Evaluation during the four editions of SemTab challenges

表格语义标注

知识图谱对齐

The following table presents the evaluation metrics used during the four editions of the SemTab challenges. On the other hand, to help new participants to have an overview of the reasons that allow to

DataCite Commons2023-02-12 更新110

Evaluation measures for ontology matchers in supervised matching scenarios

本体匹配

评估方法

Precision and Recall, as well as their combination in terms of FMeasure, are widely used measures in computer science and generally used to evaluate the overall performance of ontology matchers in f

DataCite Commons2024-06-20 更新80

OAEI Conference benchmark

本体匹配

语义查询

该数据集包含5个本体和100个手动生成的SPARQL查询，旨在用于评估本体匹配系统。此外，数据集配备了相应的问答对（CQAs），并已用于运行多个系统，以便进行性能比较。其规模涉及5个本体、100个SPARQL查询以及20个评估对，所针对的任务是本体匹配。

arXiv540

Purposes and future works of the SemTab challenges

语义表匹配

知识图谱对齐

In the table below, we provide the information on the different purposes, lessons learned and future work during the four editions of the SemTab challenge.

DataCite Commons2023-02-12 更新90