Replication Package: Tracking the Moving Target: A Framework for Continuous Evaluation of LLM Test Generation in Industry

Replication Package: Tracking the Moving Target: A Framework for Continuous Evaluation of LLM Test Generation in Industry 

This repository contains the replication package for the paper "Tracking the Moving Target: A Framework for Continuous Evaluation of LLM Test Generation in Industry".

Package Contents:

1. Example Results Documentation (`addUser-Metrics-Results_Example.zip`) 

Complete results for the `addUser` method across all evaluated LLMs 

Serves as a reference for how metrics were collected and analyzed for all methods  

2. Aggregated Results (`Aggregated_Results_by_function_Nov2024-Jan2025.zip`)

Comprehensive results for all tested methods and LLMs 

Data collected between November 2024 and January 2025 

Includes all metrics described in the paper's evaluation framework

 3. LLM Prompt (`Prompt_for_Integration_Testing-2025.pdf`) 

Final version of the prompt used to generate test cases 

Developed through prompt-chaining methodology as described in the paper 

Includes all instructions and context provided to the LLMs 

4. Source Code (`sources.tar.gz`)

Original source code for all methods used in the evaluation 

Includes necessary context and dependencies for test generation

Documentation for each method's intended functionality 

Note This is a preliminary version of the replication package. A complete version with detailed usage instructions will be provided upon paper acceptance.