RECOD.ai Events Dataset

Overview

This data set consists of links to social network items for 34 different forensic events that took place between August 14th, 2018 and January 06th, 2021. The majority of the text and images are from Twitter (a minor part is from Flickr, Facebook and Google+), and every video is from YouTube.

Data Collection

We used Social Tracker (https://github.com/MKLab-ITI/mmdemo-dockerized), along with the social medias' APIs, to gather most of the collections. For a minor part, we used Twint (https://github.com/twintproject/twint). In both cases, we provided keywords related to the event to receive the data.

It is important to mention that, in procedures like this one, usually only a small fraction of the collected data is in fact related to the event and useful for a further forensic analysis. 

Content

We have data from 34 events, and for each of them we provide the files:

items_full.csv: It contains links to any social media post that was collected.

images.csv: Enlists the images collected. In some files there is a field called "ItemUrl", that refers to the social network post (e.g., a tweet) that mentions that media.

video.csv: Urls of YouTube videos that were gathered about the event.

video_tweet.csv: This file contains IDs of tweets and IDs of YouTube videos. A tweet whose ID is in this file has a video in its content. In turn, the link of a Youtube video whose ID is in this file was mentioned by at least one collected tweet. Only two collections have this file.

description.txt: Contains some standard information about the event, and possibly some comments about any specific issue related to it.

In fact, most of the collections do not have all the files above. Such an issue is due to changes in our collection procedure throughout the time of this work.

Events

We divided the events into six groups. They are,

1. Fire

Devastating fire is the main issue of the event, therefore most of the informative pictures show flames or burned constructions

14 Events

2. Collapse

Most of the relevant images depict collapsed buildings, bridges, etc. (not caused by fire).

5 Events

3. Shooting

Likely images of guns and police officers. Few or no destruction of the environment.

5 Events

4. Demonstration

Plethora of people on the streets. Possibly some problem took place on that, but in most cases the demonstration is the actual event.

7 Events

5. Collision

Traffic collision. Pictures of damaged vehicles on an urban landscape. Possibly there are images with victims on the street.

1 Event

6. Flood

Events that range from fierce rain to a tsunami. Many pictures depict water.

2 Events

We enlist the events in the file recod-ai-events-dataset-list.pdf

Media Content

Due to the terms of use from the social networks, we do not make publicly available the texts, images and videos that were collected. However, we can provide some extra piece of media content related to one (or more) events by contacting the authors.

Funding

DéjàVu thematic project, São Paulo Research Foundation (grants 2017/12646-3, 2018/18264-8 and 2020/02241-9)