The Secret Life of CVEs - code and dataset

The Secret Life of CVEs - code and dataset. <br> Code is also available on https://github.com/ncusi/secret_life_of_CVEs <br> Code requires python 3 to run. Results of each script are saved in data directory, files without extension are pandas dataframes saved with parquet. <br> To replicate the results only, without recreating all dataset files use Jupyter notebooks from "notebooks" directory. <br> To recreate data extraction from WoC servers: Run "projects_stats/with_CVS_in_commit_message_ignore_case.sh" on WoC servers Run "cat search.CVE_in_commit_message_ignore_case.lstCmt_9.out |cut -d';' -f1 | ~/lookup/getValues c2P 1 &gt; projects_with_CVE_fix.txt" on WoC servers Run "cve_search_parser.py search.CVE_in_commit_message.lstCmt_9.out projects_with_CVE_fix.txt cve_df_filename" on WoC servers Copy the result cve_df_filename to local machine and replace cve_df_filename in data folder To recreate data processing and filtering on local machine use "dvc repro" in main directory, which will run all scripts according to "dvc.yaml", replacing data folder content when needed.