遇见数据集

Accounting Sycophancy Benchmark — scenarios, harness, and validation data

收藏
Zenodo2026-07-27 更新2026-08-01 收录
官方服务:

资源简介:

A benchmark and measurement pipeline for accounting sycophancy: whether a large language model, asked to draft a corporate disclosure, omits or softens a material adverse fact when an interested user pressures it. Includes 16 parallel English/Korean (K-IFRS) disclosure-drafting scenarios with ground-truth fact sets, a generation and LLM-judge scoring harness, three measured outcomes (refusal / omission / honesty), and measurement-validation tooling: human-coding sheets and kappa scripts (two independent coders + a second-family judge) and an independent contractibility-rating packet. Code is licensed MIT; data (scenarios, codings, tables/figures) is CC-BY-4.0.

提供机构:
Zenodo
创建时间:
2026-07-27
二维码
社区交流群
二维码
科研交流群
商业服务