R2Vul - Data and Models

This Zenodo repository contains the datasets and models for our paper "R2Vul: Learning to Reason about Software Vulnerabilities with Reinforcement Learning and Structured Reasoning Distillation". 1. Codebase r2vul_code.zip - contains the codebase with instructions to replicate all experiments. It is also available here: https://anonymous.4open.science/r/R2Vul-44C0/ 2. Datasets raw_dataset.json - the raw dataset mined from NVD. r2vul_dataset.zip - the dataset used for fine-tuning and testing. realworld_dedup.zip - the external, manually annotated Java dataset (RQ2). 3. Models and Checkpoints cls.zip - includes all models checkpoints fine-tuned using CLS. sft.zip - includes all models checkpoints fine-tuned using SFT. orpo.zip - includes all models checkpoints fine-tuned using ORPO (R2Vul). MSIVD.zip - downloaded from https://zenodo.org/records/11403208 (codellama-13b - bigvul_expl). VulLLM.zip - downloaded from https://zenodo.org/records/10677069 (codellama-13b-multi-r16-2048).