Dataset used in the paper: "Scaling laws and dynamics of hashtags on Twitter"

This dataset was used in the manuscript "Scaling laws and dynamics of hashtags on Twitter"..

The Twitter data was obtained from a sample of 10% of all public tweets, provided by the Twitter streaming application programming interface. We extracted the hashtags from each tweet and counted how many times they were used in different time intervals. Time intervals of three different lengths were used: days, hours, and minutes.  The tweets were published between November 1st 2015 and November 30th 2016, but not all time intervals between these dates are available.

The four files in this dataset correspond each to one folder (collected using tar). Each folder contains compressed .csv files (compressed using gzip). The content of the .csv files in each folder are:

hashtags_frequency_day.tar
Counts of hashtags in each day. The name of each file in the folder indicates the date (GMT). The entries in each file are the hashtag and the count in the interval.

hashtags_frequency_hour.tar
Counts of hashtags in each hour. The name of each file in the folder indicates the date (GMT). The entries in each file are the hashtag and the count in the interval.

hashtags_frequency_minutes.tar
Counts of hashtags in each minute. The name of each file in the folder indicates the date (GMT, only a fraction of all days is available). The entries in each file are the hashtag and the count in the interval.

number_of_tweets.tar
Counts of the number of tweets in each minute. The name of each file in the folder indicates the day. The entries in each file are the minute in the day (GMT) and count of tweets in our dataset.