WinoST: Evaluating Gender Bias in Speech Translation

WinoST is a challenge set for evaluating gender bias in speech translation. WinoST is the speech version of WinoMT (Stanovsky et al., 2019) which is an MT challenge set and both follow an evaluation protocol to measure gender accuracy. WinoST consists of 3888 speech audios in English plus a text file with the the text of these audios. For further details, please refer to the publication entitled "Evaluating Gender Bias in Speech Translation" (Costa-jussà et al., 2020). Also cite this publication if using this corpus.