five

"Consensus Complexity LawBench Public-Prediction Reanalysis"

收藏
DataCite Commons2026-05-14 更新2026-05-19 收录
下载链接:
https://ieee-dataport.org/documents/consensus-complexity-lawbench-public-prediction-reanalysis
下载链接
链接失效反馈
官方服务:
资源简介:
"This dataset provides derived summary tables and reproducibility code for a secondary analysis of public LawBench zero-shot per-question predictions. The analysis measures model-output non-convergence among 14 large language models across 9 discrete or normalized-answer Chinese legal tasks, covering 1,800 legal items and 25,200 model-item predictions. The main metric, Delta_model, is defined as one minus the modal-answer share for each item. The package includes task-level divergence summaries, cluster-level summaries, full pairwise agreement tables, selected pairwise comparisons, task metadata, and Python code for reproducing the analysis from separately obtained LawBench public prediction files. The dataset does not contain raw LawBench predictions, new model outputs, human-subject data, or confidential legal materials. It is intended as a derived reproducibility package for research on legal AI evaluation, model-output divergence, consensus complexity, and semantic Byzantine fault. It should be interpreted as an operational proxy for evaluating model convergence behavior, not as a direct measurement of jurisdictional or institutional legal disagreement."
提供机构:
IEEE DataPort
创建时间:
2026-05-14
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作