five

RAG Evaluation Dataset and Results

收藏
NIAID Data Ecosystem2026-05-10 收录
下载链接:
https://data.mendeley.com/datasets/wgttp36fz6
下载链接
链接失效反馈
官方服务:
资源简介:
This dataset supports the findings of the study "Knowledge Base Scope Matters: A Comparative Study of Retrieval-Augmented Generation in Academic Library Collection Development". It includes: Metadata of 525 English-language academic monographs classified under CLC class P (Astronomy and Earth Sciences), including title, author, publisher, year, CLC code, and book description. Full scoring results from three RAG configurations (NoRAG, RAG-Geo, RAG-RS), each containing a numerical quality score (0–100) and a textual rationale for each monograph. Python source code for the automated evaluation pipeline, including retrieval, scoring, statistical analysis (correlation, descriptive statistics), and visualization (boxplots, heatmaps, dual-axis plots). The knowledge base articles were sourced from the Web of Science Core Collection (SCIE). Due to licensing restrictions, only the article DOIs can be provided upon request. The Qwen3-8B model and nomic-embed-text model are open-weight and publicly accessible.
创建时间:
2026-04-17
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作