R2Vul - Data and Models

This Zenodo repository contains the datasets and models for our paper "R2Vul: Learning to Reason about Software Vulnerabilities with Reinforcement Learning and Structured Reasoning Distillation". 1. Datasets raw_dataset.json - the raw dataset mined from NVD. r2vul_dataset.zip - the dataset used for fine-tuning and testing. realworld_dedup.zip - the external, manually annotated Java dataset (RQ2). 2. Models and Checkpoints cls.zip - includes all models checkpoints fine-tuned using CLS. sft.zip - includes all models checkpoints fine-tuned using SFT. orpo.zip - includes all models checkpoints fine-tuned using ORPO (R2Vul). MSIVD.zip - downloaded from https://zenodo.org/records/11403208 (codellama-13b - bigvul_expl). VulLLM.zip - downloaded from https://zenodo.org/records/10677069 (codellama-13b-multi-r16-2048).