Sina Weibo and Bilibili platform “rat head duck neck” incident June data set
收藏资源简介:
选择新浪微博和哔哩哔哩作为数据采集平台,以江西工业职业技术学院鼠头鸭脖事件为信息源。使用 Python 爬虫收集 6 月 1 日至 6 月 29 日期间的“鼠头、鸭脖子”、“鼠头”相关数据,主要包括用户数据、行为数据(评论和转发行为)、互动文本(评论和转发文本)和帖子文本(原始微博文本)。通过相关软件进行数据清洗,清洗规则如下:(1) 清理多次转发、多级回复产生的冗余文本;(2) 清除无意义的表情符号和乱码文本;(3) 识别发布文本和互动文本中的微博主题,并将文本拆分为有主题和无主题两个文件;(4) 删除重复数据,仅保留一个条目。最后,共获得 170675 条微博用户数据、273283行为数据和互动文本、209179帖文、4078 个微博话题、115980 个哔哩哔哩平台用户数据、143468行为数据和互动文本,以及 826 条帖子文本。
We selected Sina Weibo and Bilibili as data collection platforms, taking the "rat-head duck neck" incident at Jiangxi College of Industrial Technology as the information source. We used Python crawlers to collect relevant data related to "rat head" and "rat head & duck neck" from June 1 to June 29. The collected data mainly covers four categories: user data, behavioral data (including comment and repost behaviors), interactive texts (comment and repost contents), and post texts (original Weibo posts). Subsequently, data cleaning was conducted with relevant software following these rules: 1) Remove redundant text generated by multiple reposts and multi-level replies; 2) Eliminate meaningless emojis and garbled texts; 3) Identify topics in published posts and interactive texts, and split the texts into two files: themed and unthemed; 4) Delete duplicate entries, retaining only one unique entry for each dataset. Finally, a total of 170,675 Weibo user data entries, 273,283 sets of behavioral and interactive text data, 209,179 post texts, 4,078 Weibo topics, 115,980 Bilibili user data entries, 143,468 sets of behavioral and interactive text data, and 826 Bilibili post texts were obtained.




