Replication Package: Tracking the Moving Target: A Framework for Continuous Evaluation of LLM Test Generation in Industry

Replication Package: Tracking the Moving Target: A Framework for Continuous Evaluation of LLM Test Generation in Industry This repository contains the replication package for the paper "Tracking the Moving Target: A Framework for Continuous Evaluation of LLM Test Generation in Industry". Package Contents: 1. Example Results Documentation (`addUser-Metrics-Results_Example.zip`) Complete results for the `addUser` method across all evaluated LLMs Serves as a reference for how metrics were collected and analyzed for all methods 2. Aggregated Results (`Aggregated_Results_by_function_Nov2024-Jan2025.zip`) Comprehensive results for all tested methods and LLMs Data collected between November 2024 and January 2025 Includes all metrics described in the paper's evaluation framework 3. LLM Prompt (`Prompt_for_Integration_Testing-2025.pdf`) Final version of the prompt used to generate test cases Developed through prompt-chaining methodology as described in the paper Includes all instructions and context provided to the LLMs 4. Source Code (`sources.tar.gz`) Original source code for all methods used in the evaluation Includes necessary context and dependencies for test generation Documentation for each method's intended functionality Note This is a preliminary version of the replication package. A complete version with detailed usage instructions will be provided upon paper acceptance.