遇见数据集

ALE: Pre-registered protocol for the expert evaluation of the ALE AI agro-advisor, with rubric and data templates (D9)

收藏
Zenodo2026-11-02 更新2026-11-05 收录
官方服务:

资源简介:

Pre-registered protocol (version 1.0, published before data collection) for the blind expert evaluation of the answers of the generative AI assistant of the ALE intelligent environment for agricultural advisory services under three conditions: C0 - base language model; C1 - model with the system instruction of the AI agro-advisor (10.5281/zenodo.22648444); C2 - model with the instruction, context and constraints from the ALE ontology 1.0.0 (10.5281/zenodo.23643625) and the Semantic MediaWiki knowledge base. Design: 120 farmer queries (30 per category K1-K4), 360 answers, at least three expert agronomists with at least 10 years of practical experience, five criteria rated 1-5 and a hallucination flag, non-parametric analysis (Friedman, Wilcoxon with Holm correction, Cochran's Q, Krippendorff's α). The record contains the protocol in Ukrainian and English, the rubric, an error typology, the target corpus composition, empty templates of the corpus, generation log, answer sheet and condition key, a synthetic example and a codebook. The corpus will be added as a new version; ratings will be published as dataset D10. Terminology: ALE stands for Advisory Learning Ecosystem (the ontology); the software system is called the ALE intelligent environment. Funding: Ministry of Education and Science of Ukraine, project "Development of an Intelligent Support Environment for Agricultural Advisory Services Based on the Integration of Semantic Wiki Technologies and Artificial Intelligence" (state registration No. 0126U000765).

提供机构:
Zenodo
创建时间:
2026-11-02
二维码
社区交流群
二维码
科研交流群
商业服务