VILEXNORM

VILEXNORM是首个针对越南语词汇规范化任务开发的数据集，由越南信息技术大学的信息科学与工程学院创建。该数据集包含超过10,000对经过人工标注的句子，这些句子来源于越南最流行的社交媒体平台上的公开评论。数据集的创建过程涉及严格的数据收集和预处理，以及多样的评估方法，旨在提高自然语言处理系统在处理非标准文本时的性能。VILEXNORM的应用领域包括提高越南语词汇规范化任务的效率，以及改善其他自然语言处理任务的性能，如情感分析和机器翻译。

VILEXNORM, the first dataset dedicated to the Vietnamese lexical normalization task, was developed and curated by the School of Information Science and Engineering of Vietnam University of Information Technology. This dataset comprises over 10,000 manually annotated sentence pairs, sourced from public comments posted on Vietnam's leading social media platforms. The construction of VILEXNORM involves rigorous data collection and preprocessing, as well as the implementation of diverse evaluation methodologies, with the core objective of enhancing the performance of natural language processing systems when handling non-standard textual data. The applicable scenarios of VILEXNORM include enhancing the efficiency of Vietnamese lexical normalization tasks and improving the performance of other natural language processing tasks such as sentiment analysis and machine translation.