BioWiC

We present the BioWiC benchmark, a new dataset designed to assess how well language models represent biomedical concepts according to their corresponding context. BioWiC is formulated as a binary classification task where each instance involves a pair of biomedical terms along with their corresponding sentences. The task is to classify each instance as True if the target terms carry the same meaning across both sentences or False if they do not.