Example illustrating dataset prevalence independence.

Here in the two cases shown above the underlying classification quality is the same, conditions A and B are detected 100% of the time and condition X is detected 50% of the time, only the prevalence in the dataset has changed (in Case 1—{X, A} occurs 10% of the time and in Case 2—90% of the time). However unlike other metrics (e.g. F1 score), this doesn’t change the MedTric score thus demonstrating dataset prevalence invariance.