BLEU Reduction denotes the reduction in BLEU score from the uncompressed model’s score of 34.63. The accuracy of the model increases for PET when we apply the pre-training with the simplified task.
BLEU Reduction denotes the reduction in BLEU score from the uncompressed model’s score of 34.63. The accuracy of the model increases for PET when we apply the pre-training with the simplified task.