five

Improving LLM Code Generation via Testing and Static Analysis Feedback

收藏
DataCite Commons2024-09-11 更新2024-11-06 收录
下载链接:
https://figshare.com/articles/dataset/Improving_LLM_Code_Generation_via_Testing_and_Static_Analysis_Feedback/26984716/1
下载链接
链接失效反馈
官方服务:
资源简介:
- assertion: Scripts for the (in)correctness analysis + Results for first generation and repair phase experiments- compilation: Scripts to do code refactoring on the generated files and get the compiling files- correctness_stats: Aggregate stats for the (in)correctness analysis- dataset: Contains the dataset used for the experiments (100_clean_tasks.json) and other additional files- files_to_analyze_strict: Files to analyze in the phases after the generation. These are the 89 files that compile for all the models- first_gen_output_prompt*: Generated output for the first generation of the prompt experiments- generation: Script for interacting and prompting the models to obtain the output for each phase- infer: Vulnerability report created by Infer for the first generation and the vulnerability repair phase + scripts for running Infer- infer_stats: Vulnerability stats for the first generation and the repair phase - including the repair prompt experiments- iterations-correctness: Generated output for the correctness repair experiments at each iteration- iterations-vulnerabilities: Generated output for the vulnerability repair experiments at each iteration- prompt_experiments: Contains prompts and some results for the prompt experiments that we ran- regeneration_output_correctness_prompt*: Generated output for the correctness repair experiments- regeneration_output_vulnerability_prompt*: Generated output for the vulnerability repair experiments- self_correctness_output_prompt*: Generated output for the self-correctness experiments- self_safety_output_prompt*: Generated output for the self-correctness experiments- self_correctness_stats: Generated stats for the self-correctness experiments- self_safety_stats: Generated stats for the self-safety experiments- stats: Python script for obtaining different stats- folder_descr.txt: this file. description of the folders in this directory- README.md: pipeline description with some results reported in the paper<br>
提供机构:
figshare
创建时间:
2024-09-11
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作