SQL checker experiment data package: Outdated checker feedback in SQL maintenance agents under changing business rules
收藏资源简介:
This package contains the frozen protocol, implementation code, raw model runs, action traces, analysis scripts, and measurement checks for the study "Outdated checker feedback in SQL maintenance agents under changing business rules." The experiment investigates how checker feedback affects a maintenance agent when the active contract is explicitly available and the checker may still evaluate an earlier rule. The data includes 192 primary episodes and a 24-episode interface follow-up across six synthetic SQLite task families, two rule states, four checker conditions, and two model configurations (Qwen2.5-Coder 3B and Qwen3-1.7B). Contents:- protocol/: Experimental protocol, design.json, scenarios.py- implementation/: Agent harness, evaluation infrastructure (6 Python files)- traces/primary/: 192 primary episode traces (JSON files)- traces/followup/: 24 follow-up episode traces (JSON files)- analysis/: Analysis scripts and results (5 files)- replay/: Replay verification script Model weights are excluded due to size and licensing. The models used (Qwen2.5-Coder 3B Instruct and Qwen3-1.7B Instruct) are available from Hugging Face under their respective licenses.



