Word-in-Context Target Sense Verification

<pre>Formally, WiC is framed as a <strong>binary classification</strong> task. Each instance in WiC-TSV consists of a target word <em>w</em> with a corresponding target sense <em>s</em> represented by either its definition (subtask 1) or its hypernym/s (subtask 2), and a context <em>c</em> containing the target word <em>w</em>. The task aims to determine whether the meaning of the word <em>w</em> used in the context <em>c</em> matches the target sense <em>s</em>. In the following table there are some examples from the dataset. </pre> Subtasks WiC-TSV has <strong>three subtasks</strong> - participants can submit results in any of the subtasks: Subtask 1: Definitions In Subtask 1 systems make use of <strong>definitions</strong> for deciding whether the target word in context corresponds to the given definition or not. Subtask 2: Hypernyms In Subtask 2 systems make use of <strong>hypernymy</strong> information for deciding whether the target word in context is a hyponym of the given hypernym or not. Subtask 3: Definitions + Hypernyms In subtask 3 systems can make use of <strong>both</strong> sources of information, i.e., definitions and hypernyms.正式而言，语境词义判别任务（Word-in-Context，简称WiC）被构建为一项**二元分类（binary classification）**任务。WiC-TSV的每个样本均包含目标词<em>w</em>、由其释义（对应子任务1）或上位词（hypernym）（对应子任务2）表示的对应目标义项<em>s</em>，以及包含该目标词<em>w</em>的上下文<em>c</em>。本任务旨在判断上下文<em>c</em>中使用的词<em>w</em>的语义是否与目标义项<em>s</em>相符。下表展示了该数据集的部分示例。 子任务 WiC-TSV包含**三个子任务**，参与者可针对任意子任务提交结果： 子任务1：释义 在子任务1中，系统需借助**释义**信息，判断上下文内的目标词是否与给定释义相符。 子任务2：上位词 在子任务2中，系统需借助**上位义关系（hypernymy）**信息，判断上下文内的目标词是否为给定上位词（hypernym）的下位词（hyponym）。 子任务3：释义+上位词 在子任务3中，系统可同时使用两类信息源，即释义与上位词（hypernym）。