Word-in-Context Target Sense Verification

<pre>Formally, WiC is framed as a <strong>binary classification</strong> task. Each instance in WiC-TSV consists of a target word <em>w</em> with a corresponding target sense <em>s</em> represented by either its definition (subtask 1) or its hypernym/s (subtask 2), and a context <em>c</em> containing the target word <em>w</em>. The task aims to determine whether the meaning of the word <em>w</em> used in the context <em>c</em> matches the target sense <em>s</em>. In the following table there are some examples from the dataset. </pre> Subtasks WiC-TSV has <strong>three subtasks</strong> - participants can submit results in any of the subtasks: Subtask 1: Definitions In Subtask 1 systems make use of <strong>definitions</strong> for deciding whether the target word in context corresponds to the given definition or not. Subtask 2: Hypernyms In Subtask 2 systems make use of <strong>hypernymy</strong> information for deciding whether the target word in context is a hyponym of the given hypernym or not. Subtask 3: Definitions + Hypernyms In subtask 3 systems can make use of <strong>both</strong> sources of information, i.e., definitions and hypernyms.