five

LLM ISO Benchmark: frontier AI models on a deterministic ISO/AMT tax optimization problem

收藏
Zenodo2026-06-18 更新2026-06-21 收录
下载链接:
https://zenodo.org/doi/10.5281/zenodo.20746889
下载链接
链接失效反馈
官方服务:
资源简介:
A reproducible benchmark in which frontier large language models are given an identical incentive stock option (ISO) exercise optimization problem and scored against a deterministic ground truth. Across two rounds (May 2026 and June 2026), thirty verbatim model responses are preserved alongside the prompt, the locked scenario inputs, and the scoring methodology. The headline finding is stable: every model overstates the achievable after-tax outcome by a factor of roughly 2x to 20x when it computes the multi-year tax math in-context. Living results page: optionsahoy.com/benchmark.
提供机构:
Zenodo
创建时间:
2026-06-18
二维码
社区交流群
二维码
科研交流群
商业服务