AQL queries and benchmark results from PhD thesis "ANNIS: A graph-based query system for deeply annotated text corpora"

These are the queries, the benchmark results and the evaluation scripts of the thesis "ANNIS: A graph-based query system for deeply annotated text corpora" (Thomas Krause 2018, Humboldt-Universität zu Berlin) diss_2018-01-12_v0.5.0.csv Results of all configurations of executed benchmarks for graphANNIS and also the baseline times of relANNIS. queries.zip Contains folders for each corpus containing all queries used for the benchmark. Each file-name begins with the ID of the query. The extension denotes the type, which can be one of the following: ".aql" contains the original AQL (ANNIS query language) query which was collected ".json" is JSON representation of the parsed AQL query ".count" is the number of matches a query should have ".time" is the average time in milliseconds that was needed to execute the query in relANNIS on the benchmark system ".corpora" contains the name of the corpus the query belongs to (should be only one corpus and the same as the folder name in the selection of queries in this data set) ".relplan" contains the PostgreSQL plan for the query ".graphplan" contains the graphANNIS plan for the query evaluation-scripts.py/evaluation-scripts.ipynb Python scripts to perform the evaluation and generate the images. This are both a Python-file and the original notebook file that can be used with the Jupyter Notebook application. relannis_benchmark_scripts.zip The files in this zip-file can be used to execute the benchmarks in the relANNIS system by piping the into the "annis.sh" command line tool of relANNIS