Summary Type I error.

Summary table of nine type I error experiments evaluated at three alpha levels (i.e. 0.05, 0.01, 0.001) for our 4 ensemble methods and 59 state-of-the-art methods. 27 type I error results generated per test. Prop exp type I error Good: computed as the number of times a test managed to control type I error divided by 27. Prop exp type I error Inflated: the proportion of time, out of the 27 results, in which a test had an inflated type I error. Prop exp Type I error Conservative: the proportion of time, out of the 27 results, in which a test had a conservative type I error. Prop exp type I error NA: proportion of time a test failed to return a p-value divided by 27. Reliability: defined as the sum of significant and non-significant p-values divided by the number of replicates (i.e. 10000). Reliability min: indicates the lowest reliability among all nine experiments. Reliability max: indicates the highest reliability among all nine experiments. Reliability median: gives the median proportion of time a test returned a p-value divided by the expected returned p-values (i.e. 10 000 per experiment) across all nine experiments.
(XLSX)