遇见数据集

Replication Package: Do LLMs Understand Compiler Errors? A Compiler-Grounded Study of First-Diagnostic Control

收藏
Zenodo2026-03-27 更新2026-05-26 收录
官方服务:

资源简介:

Replication package for the ASE 2026 submission "Do LLMs Understand Compiler Errors? A Compiler-Grounded Study of First-Diagnostic Control." Contents:- 12,800 raw LLM outputs (8 models × 8 error types × 2 languages × 100 samples)- MSVP verification pipeline (deterministic compiler-based classification)- Prompt templates (generation, recognition, IBP, CDP, refinement)- Baseline results (rule-based mutation, 1-shot, chain-of-thought)- Cross-compiler analysis (gcc-14 vs clang-18)- Expert judgment survey data- All analysis scripts for reproducing tables and figures See README.md for setup and reproduction instructions.

提供机构:
Zenodo
创建时间:
2026-03-27
二维码
社区交流群
二维码
科研交流群
商业服务