Improving LLM Code Generation via Testing and Static Analysis Feedback
收藏Figshare2024-09-11 更新2026-04-08 收录
下载链接:
https://figshare.com/articles/dataset/Improving_LLM_Code_Generation_via_Testing_and_Static_Analysis_Feedback/26984716/1
下载链接
链接失效反馈官方服务:
资源简介:
- assertion: Scripts for the (in)correctness analysis + Results for first generation and repair phase experiments- compilation: Scripts to do code refactoring on the generated files and get the compiling files- correctness_stats: Aggregate stats for the (in)correctness analysis- dataset: Contains the dataset used for the experiments (100_clean_tasks.json) and other additional files- files_to_analyze_strict: Files to analyze in the phases after the generation. These are the 89 files that compile for all the models- first_gen_output_prompt*: Generated output for the first generation of the prompt experiments- generation: Script for interacting and prompting the models to obtain the output for each phase- infer: Vulnerability report created by Infer for the first generation and the vulnerability repair phase + scripts for running Infer- infer_stats: Vulnerability stats for the first generation and the repair phase - including the repair prompt experiments- iterations-correctness: Generated output for the correctness repair experiments at each iteration- iterations-vulnerabilities: Generated output for the vulnerability repair experiments at each iteration- prompt_experiments: Contains prompts and some results for the prompt experiments that we ran- regeneration_output_correctness_prompt*: Generated output for the correctness repair experiments- regeneration_output_vulnerability_prompt*: Generated output for the vulnerability repair experiments- self_correctness_output_prompt*: Generated output for the self-correctness experiments- self_safety_output_prompt*: Generated output for the self-correctness experiments- self_correctness_stats: Generated stats for the self-correctness experiments- self_safety_stats: Generated stats for the self-safety experiments- stats: Python script for obtaining different stats- folder_descr.txt: this file. description of the folders in this directory- README.md: pipeline description with some results reported in the paper<br>
提供机构:
Arceri, Vincenzo
创建时间:
2024-09-11



