On the Replicability of Experimental Tool Evaluations in Model-Based Development

If you are also interested in open science for Simulink, please answer our 5-10 min survey, to help you get Simulink models you need: https://forms.gle/as3Jww5LSEE5pSYW8 

Model files, used in research papers, are located in sub directories.

Each sub directoy corresponds to one research paper.

A key to the number of the sub directory is listed below.

Each number also corresponds to the line number in the raw_data.xlsx file with the raw data.

184 Automated Test Suite Generation for Time-Continuous Simulink Models

224 Component and Connector Views in Practice: An Experience Report

350 Evaluating Model Testing and Model Checking for Finding Requirements Violations in Simulink Models

409 From Design Contracts to Component Requirements Verification

451 Hybrid Automata: From Verification to Implementation

594 Multi-Objective Black-Box Test Case Selection for Cost-Effectively Testing Simulation Models

662 Pareto efficient multi-objective black-box test case selection for simulation-based testing

722 Quantifying Conformance Using the Skorokhod Metric

769 Search-based automated testing of continuous controllers: Framework, tool support, and case studies

882 Towards Commoditizing Simulations of System Models Using Recurrent Neural Networks

# Papers referenced as having provided models

Below is a list of papers referencing other papers.

Each referenced paper is supposed to have provided model files for the referencing paper.

Papers starting a line are referencing, tabbed papers are being referenced.

https://doi.org/10.1016/j.jss.2016.07.001

https://doi.org/10.1016/j.jss.2007.05.039

https://doi.org/10.1109/TSE.2017.2694423

https://doi.org/10.1016/j.ic.2014.01.014

https://doi.org/10.1145/3005446

https://doi.org/10.1109/MDT.2012.2205998

https://doi.org/10.1145/3180155.3180231

https://doi.org/10.1145/3196478.3196484

https://doi.org/10.1007/s10270-015-0477-x

https://doi.org/10.1007/978-3-319-12241-0_8

http://www.sciencedirect.com/science/article/pii/S0950584918301721

https://doi.org/10.1145/3106237.3117770

https://doi.org/10.1145/2884781.2884797

https://doi.org/10.29007/x87p

https://doi.org/10.1016/j.jss.2007.05.039

https://doi.org/10.1007/s10703-016-0261-8

https://doi.org/10.1145/2562059.2562140

https://doi.org/10.1145/2562059.2562139

https://doi.org/10.1109/ISMVL.2015.17

https://doi.org/10.1007/3-540-44804-7_3

https://doi.org/10.3233/JCS-2004-123-403

https://doi.org/10.1016/0020-0190(90)90107-9

https://doi.org/10.1145/2889160.2889162

https://doi.org/10.1145/2786805.2786818

https://doi.org/10.1145/2884781.2884797

https://doi.org/10.3233/FI-2016-1444

https://doi.org/10.1007/978-3-642-39799-8_21

https://doi.org/10.1109/PDP.2014.32

https://doi.org/10.1007/s10703-009-0076-y

https://doi.org/10.1007/s10703-013-0195-3

https://doi.org/10.1007/978-3-319-29778-1_8

https://doi.org/10.1109/ISSRE.2012.35

https://doi.org/10.9790/2834-0637982

https://doi.org/10.1109/DSD.2016.37

https://doi.org/10.1109/ISMICT.2016.7498881

https://doi.org/10.1109/DSD.2015.11

https://doi.org/10.1109/WICSA.2016.23

https://doi.org/10.1109/ICSE.2012.6227161

https://doi.org/10.1016/j.scico.2015.07.005

https://doi.org/10.1109/PDP.2015.102

https://doi.org/10.13140/2.1.3463.7608

https://doi.org/10.1007/978-3-642-24559-6_21

https://doi.org/10.1145/3170500

https://doi.org/10.29007/23pm

Xiaoqing Jin, Jyotirmoy V. Deshmukh, James Kapinski, Koichi Ueda, and Ken Butts. 2014. Benchmarks for model transformations and conformance checking. In Proceedings of the 1st International Workshop on Applied Verification for Continuous and Hybrid Systems (ARCH’14).

https://doi.org/10.1109/TCAD.2015.2421907

https://doi.org/10.1007/978-3-642-14295-6_17

https://doi.org/10.1007/978-3-642-19835-9_21

https://doi.org/10.1109/TEC.2014.2362716

https://doi.org/10.1016/j.jss.2007.05.039 is listed twice

https://doi.org/10.1145/2884781.2884797 is listed twice

# Overview

This data set provides raw data and Simulink models of our study "On the Replicability of Experimental Tool Evaluations in Model-Based Development".

In this data set, we list all Simulink models we found in other papers. We also give the raw data of the literature review.

# Directory key: