Effectiveness of labels in digital art experience: psychophysiological and behavioral evidence

The "Experimental condition" folder comprises data from 40 participants: folders from S01 to S34 include Empatica and Pupil Labs recordings, along with a MATLAB matrix; folders from S35 to S40 contain only the MATLAB matrix.

The "Control condition" folder contains data from 20 participants: folders from S01 to S15 include Empatica and Pupil Labs recordings, along with a MATLAB matrix; folders from S16 to S20 only contain the MATLAB matrix.

In the MATLAB matrix, each row corresponds to a trial. The columns indicate:

1.    Number of painting

2.    Start time of reading label

3.    End time of reading label

4.    Start time of viewing painting

5.    End time of viewing painting

6.    Response to the item questionnaire about liking (“How much do you like the painting?”) - 5-points Likert scale

7.    Response to the item questionnaire about interest (“How interested are you in the painting?”) - 5-points Likert scale

8.    Response to the item questionnaire about complexity (“How complex do you find the painting?”) - 5-points Likert scale

9.    Response to the item questionnaire about comprehensibility (“How comprehensible do you find the painting?”) - 5-points Likert scale

10. Response to the item questionnaire about title informativeness (“How informative do you find the title of the painting?") - 5-points Likert scale

11.Response to the item questionnaire about positive emotions (“How much does this painting evoke positive emotions in you?”) - 5-points Likert scale

12.Response to the item questionnaire about negative emotions (“How much does this painting evoke negative emotions in you?”) - 5-points Likert scale

13.Response to the item questionnaire about curiosity for other works (“How curious are you about seeing works by the same author?”) - 5-points Likert scale

The “Empatica” folder contains several ”.csv” files extracted from the Empatica wristband. In our work, we used:

-     EDA - data from the electrodermal activity sensor expressed in microsiemens (μS). The sample rate is 4 Hz.

-     HR - Average heart rate extracted from the BVP signal. The first row is the initial time of the session expressed as unix timestamp in UTC. The second row is the sample rate expressed in Hz.

The “Pupil” folder contains several “.csv” files obtained from the Pupil Core Eye Tracker. These files have been exported using the Pupil Player Software. In our work, we used the exported file “pupil_positions.csv”, that includes:

-       timestamp - timestamp of the source image frame

-       index – associated frame: closest world video frame

-       id - 0 or 1 for right and left eye (from the wearer's point of view)

-       confidence - is an assessment by the pupil detector on how sure we can be on this measurement. A value of `0` indicates no confidence. `1` indicates perfect confidence.

-       norm_pos_x - x position in the eye image frame in normalized coordinates

-       norm_pos_y - y position in the eye image frame in normalized coordinates

-       diameter - diameter of the pupil in image pixels as observed in the eye image frame (is not corrected for perspective)

-       method - string that indicates what detector was used to detect the pupil (2d the pupil appears as an ellipse available in `3d c++` and `2D c++` detector)

-       ellipse_center_x - x center of the pupil in image pixels

-       ellipse_center_y - y center of the pupil in image pixels

-       ellipse_axis_a - first axis of the pupil ellipse in pixels

-       ellipse_axis_b - second axis of the pupil ellipse in pixels

-       ellipse_angle - angle of the ellipse in degree.

The gaze data, as described in the Data processing section of our work, were extracted from the video recordings of each session, which were not uploaded here for privacy reasons.