遇见数据集

Benchmark and Item-Level Results for "Can Local Large Language Models Screen and Revise Questionnaire Items? Evidence from a 200-Item Defect Benchmark"

收藏
Zenodo2026-11-01 更新2026-11-05 收录
官方服务:

资源简介:

Item-level outputs behind the manuscript "Can Local Large Language Models Screen and Revise Questionnaire Items? Evidence from a 200-Item Defect Benchmark". The archive contains the 200-item gold benchmark (40 clean controls, 160 flawed items under a 16-label defect taxonomy), the labels predicted and revisions produced by a baseline checker-reviser workflow and an orchestrated, role-separated workflow, the run metrics and configurations, and a detection-matched revision analysis with its script. The runs cover Qwen3.5-9B under three prompt conditions and Mistral-7B-Instruct-v0.3 and Gemma-2-9B-it under the first prompt condition. See README.md in the archive for the file layout and the limitations.

提供机构:
Zenodo
创建时间:
2026-11-01
二维码
社区交流群
二维码
科研交流群
商业服务