Detecting Usage Protocol Violations in Deep Learning Applications

This repo contains a replication package of the "Detecting Usage Protocol Violations in Deep Learning Applications" paper.
In the paper, we use two benchmarks:  

The first benchmark we used from NeuraLint can be found under the director name Benchmark1/SOSamples
The second benchmark we used from Humbatova et al. can be found under the director name Benchmark2/SOSamples
To reproduce the results in the paper:  

Download the NeuralStateAnalysis Zip file.
Extract the file and go to the NeuralStateAnlaysis directory.
( Optional ) Install the requirements by running 'Pip install requirements.txt.' N.B: The requirements.txt file is already in this repo.

To run NeuralState on Benchmark1:

Go to Benchmark1/SOSamples directory,
Open any of the programs you want to run,
Set the path: Path-to-folder/NeuralStateAnalysis/
Then, do 'python program_id.' Since the 'NeuralStateAnalysis(model).debug()' call is already present in all programs, you'll be able to reproduce results.
To run NeuralState on Benchmark2:

Go to Benchmark2/SOSamples directory,
Open any of the programs you want to run,
Set the path: Path-to-folder/NeuralStateAnalysis/
Then, do 'python program_id.' Since the 'NeuralStateAnalysis(model).debug()' call is already present in all programs, you'll be able to reproduce results.