TELL me what you See (TESE)

Dataset reported in the deliverable D3.10

Description

TEll me what you SEe (TESE) dataset is a gaze annotated dataset, tailored for training deep learning architectures and extracting useful viewing patterns. It was created following the “description” paradigm where subjects were asked to orally describe visual scenes. Fifty-six different subjects participated in the recording procedure using Tobbi Pro eye tracker sensor. The publicly available Visual Genome (VG) dataset is a generic content image database with object bounding box, class and relation dense annotations.

Content

The gaze annotations are provided with the JSON file format using the following naming convention.
imageID.json
The imageID denotes the Visual Genome image id which is actually the filename of the image. Inside the JSON file gaze points annotations, timestamp and x,y coordinates and transcribed text from voice description are included as presented below.
{“subjectID”:1,
“gaze”:[{“Time”: 6105.218916422819, “X”: 0.5127838850021362, “Y”: 0.4649979770183563},
{“Time”: 6105.2274152988775, “X”: 0.507378339767456, “Y”: 0.4624013900756836}]
}
In addition, the subjects.json file provides information about the subjects as described below.
[{“id”: “1”, “gender”: “Male”, “age”: “38”},
{“id”: “2”, “gender”: “Female”, “age”: “29”}]