Tweets to Donald Trump (@realDonaldTrump)
收藏资源简介:
362,464,578 tweet ids for tweets directed at Donald Trump (@realDonaldTrump), collected with Documenting the Now's twarc. Tweets can be “rehydrated” with Documenting the Now’s twarc, or Hydrator. twarc hydrate to_realdonaldtrump_20210120_ids.txt > to_realdonaldtrump_20210120.jsonl. Collection notes: Tweets from May 7, 2017 - October 16, 2018 of the dataset used a combination of the Filter (Streaming) API and Search API. The Filter API failed on June 21, 2017. From June 23, 2017 forward only the Search API was used to collect. Collection was done every 5 days on a cron job, and periodically deduplicated. There is a data gap from Tue Jul 28 13:53:50 +0000 2020 through Thu Aug 06 09:36:23 +0000 2020 due to a collection error. This dataset also includes a number of derivative csv files from the original jsonl collected. This includes: A user csv file created with jq (see below). twut userInfo twut language twut times twut sources twut hashtags twut urls twut animatedGifUrls twut imageUrls twut mediaUrls twut videoUrls User csv: jq -r '[.id_str, .created_at, .user.screen_name, .retweeted_status != null] | @csv' to_realdonaldtrump_20190130.jsonl > to_realdonaldtrump_20190130_users.jsonl
本数据集包含362,464,578条针对唐纳德·特朗普(Donald Trump,@realDonaldTrump)的推文ID,采用Documenting the Now的twarc工具采集所得。推文可通过Documenting the Now的twarc或Hydrator工具进行重水化操作,即通过推文ID还原完整推文内容,具体执行命令为:twarc hydrate to_realdonaldtrump_20210120_ids.txt > to_realdonaldtrump_20210120.jsonl。 采集备注:本数据集涵盖的推文发布时间为2017年5月7日至2018年10月16日,采集初期同时使用了过滤流API(Filter Streaming API)与搜索API(Search API)。2017年6月21日过滤流API出现故障,自2017年6月23日起,仅通过搜索API完成推文采集。采集任务通过cron定时任务每5天执行一次,并定期进行去重处理。 由于采集异常,2020年7月28日13:53:50 +0000至2020年8月6日09:36:23 +0000期间存在数据空缺。 本数据集还包含基于原始jsonl文件生成的若干衍生CSV文件,具体包括:通过jq工具生成的用户信息CSV文件(操作说明详见下文)。衍生文件涵盖的字段有:推文用户信息、推文语言、推文发布频次、推文来源、推文话题标签、推文链接、动图链接、图片链接、多媒体链接、视频链接。 用户信息CSV文件的生成命令为:jq -r '[.id_str, .created_at, .user.screen_name, .retweeted_status != null] | @csv' to_realdonaldtrump_20190130.jsonl > to_realdonaldtrump_20190130_users.jsonl



