SemEval-2020 Task 3: Graded Word Similarity in Context Subtask 2

Subtask 2 in the "Graded Word Similarity in Context" SemEval-2020 Shared Task aims to predict the the absolute similarity rating for each pair in each of the different contexts. The subtask evaluates systems across four different languages, viz. English, Croatian, Slovene, and Finnish. In this comparison, the top three participating teams are compared for the subtask in each of the four language evaluations, respectively. The evaluation metric is harmonic mean of the Pearson and the Spearman correlations between the system's results and the average of the human annotations.