Overview of commonly used open-source licenses in benchmarking studies.

Code or data with restrictions to redistribute or modify are not suitable for collaborative benchmarking. License: license name. Redistribution: right to redistribute, e.g., reuse in another benchmark/somewhere else. Modification: right to modify the code to produce derivative works, e.g., in another benchmark/somewhere else. Sublicensing: for derivative works, obligation to keep the same license or freedom to be licensed differently (even copyright). Relevant if the code contributor does not want derivative works to be ‘closed source’ or copyrighted. Commercial use: for derivative works, whether commercial usage is restricted or not. Relevant to code contributors not willing commercial reuse of their code (by others). Attribution: for derivative works, obligation to attribute original author(s). Relevant to code contributors willing their names/authorship to be credited in derivative works. Linking: dynamic or static linking / use as libraries. Particularly important for metrics, as these code can be frequently incorporated (=executed) across benchmarks.