my_roberta-base_pre-train

This research presents a new pre-trained RoBERTa model based on a convolutional neural network. It belongs to the family of transformer methods that use "attention" mechanisms. It improves the feature