IPC+AL (Active Learning Enhanced Interactive Prompt Clarification (IPC)) Experiment

This document serves as the companion reproducibility package for the manuscript\emph{IPC+AL: Active Learning--Governed Interactive Prompt Clarification for Safety-Critical IEC~61131-3 PLC Code Generation}.It provides (i) a complete, implementation-level specification of the IPC+AL protocol and (ii) a transparent replication workflow for benchmarking IPC+AL against IPC and the baseline prompting suite (RaR, APE, AP, ReAct, MTPR) on external PLC datasets. To enable independent reproduction, the package consolidates the full prompt cards, fixed protocol obligations, and artifact schemas used in the study, including the baseline prompts, the IPC protocol, and the IPC+AL extension. Complete, executable prompt instances are provided for both evaluation settings: the Batch Mixing Process dataset and the Robot Pick-and-Place dataset. By keeping the protocol components fixed and substituting only task instances, external researchers can instantiate IPC and IPC+AL on arbitrary industrial use cases and alternative PLC benchmarks. The documentation further specifies end-to-end procedures for evaluation and governance, including LLM-in-the-Loop (LITL) validation with interchangeable validator committees (e.g., ChatGPT, Copilot Pro, Gemini or user-specified LLMs), and Human-in-the-Loop (HITL) expert assessment. Inter-rater reliability (IRR) is formalized at the gate level using Cohen’s $\kappa$ (pairwise agreement) and Krippendorff’s $\alpha$ (multi-rater agreement), with IRR computed \emph{across tasks} ($N$, e.g., 25 industrial use cases) rather than across prompt methods ($M$), preserving the rater--item structure required for statistically valid agreement estimates. Overall, this package is intended to function as a standalone replication manual: by fixing the protocol and acceptance gates while varying only task instances and validator choices, external reviewers and researchers can regenerate all intermediate artifacts, recompute the reported statistics, and verify that IPC+AL consistently overcomes IPC and the baseline family under controlled, auditable conditions.