A Large Scale Tweet Dataset for Urdu Text Sentiment Analysis

This is a dataset of tweets in the Urdu language. There are 1,140,824 tweets in the dataset, collected from Twitter for September and October 2020. This large-scale corpus of tweets is generated by performing preprocessing, which includes removing columns containing user information, retweet’s count, followers, and duplicate tweets, removing unnecessary punctuations, links, symbols, and spaces, and finally extracting emojis if present in the tweet text. This dataset's final tweet record contains columns for tweet id, text, and emoji extracted from the text with a sentiment score. Emojis are extracted to validate Machine Learning models used for the multilingual sentiment and behavior analysis.

本数据集为乌尔都语（Urdu）推文数据集，共包含1,140,824条推文，采集自2020年9月至10月的Twitter平台。该大规模推文语料库通过预处理流程生成，预处理步骤包括：移除包含用户信息、转发数、关注者数及重复推文的字段；去除冗余标点、链接、符号与空格；若推文中包含表情符号，则最终提取其表情信息。本数据集的最终推文记录包含推文ID、推文文本、从文本中提取的表情符号以及情感得分四个字段。提取表情符号的目的，是为了验证用于多语言情感与行为分析的机器学习（Machine Learning）模型。