NEWBEE: A Multi-Modal Gait Database of Natural Everyday-Walk in an Urban Environment -- Addendum

NEWBEE: A Multi-Modal Gait Database of Natural Everyday-Walk in an Urban Environment -- AddendumAuthors: M. Hasenjaeger, V. LosingAffiliation: Honda Research Institute Europe GmbHAddress: Carl-Legien-Str. 30, 63065 Offenbach am Main, Germany<br>Corresponding author: M. HasenjaegerContact information: [e-mail] INTRODUCTIONThis dataset is an addendum to the data published in [1]. It contains the gaze positions and eyetracker IMU data (1) in raw format as exported from the eyetracker and (2) synchronized with the remaining data in [1].The data is being made public as supplementary data for publications and in order for other researchers to use these data in their own work.METHODSThe data were recorded from 20 healthy participants (five females, fifteen males, between 18 and 69 years old, 178.5 +/- 7.64 cm, 72.9 +/- 8.7 kg).Data recordings took place around a suburban train station close to Frankfurt/Main in Germany. All participants provided written informed consent, including written permission to publish the data of the study. The study was approved by the Bioethics Committee in Honda’s R&amp;D (97HM-036H, Dec. 14, 2020).The data recording procedure is described in detail in [2].DESCRIPTION OF THE DATA IN THIS DATA SETDIRECTORY STRUCTUREThe data in this dataset has been organized as follows:eyetracker / raw_data / gaze_positions / <i>data-files</i>eyetracker / raw_data / imu_data / <i>data-files</i>eyetracker / sync_data / <i>data-files</i>The subdirectory 'raw_data' contains the raw data from the PupilInvisible eyetracker as exported by PupilPlayer where the gaze positions are located in 'raw_data/gaze_positions' and the IMU data are located in 'raw_data/imu_data'.The subdirectory 'sync_data' contains gaze positions and IMU data that are synchronized with the data set [1], i.e. the time stamps are identical.FILES<b>eyetracker / raw_data / gaze_positions</b>For each experiment course and participant there is a file _-gaze_positions.csv in csv format with the following columns:<br> gaze_timestamp : timestamp of the source image frame world_index : index of closest world video frame (world videos are not included with this data set) confidence : computed confidence between 0 (not confident) -1 (confident) norm_pos_x : x position in the world image frame in normalized coordinates norm_pos_y : y position in the world image frame in normalized coordinates# remaining data columns were not available for Pupil Invisible at time of export and hence are empty base_data : timestamp-id of pupil data that this gaze position is computed from gaze_point_3d_x : x position of the 3d gaze point (the point the subject lookes at) in the world camera coordinate system gaze_point_3d_y : y position of the 3d gaze point gaze_point_3d_z : z position of the 3d gaze point eye_center0_3d_x : x center of eye-ball 0 in the world camera coordinate system (of camera 0 for binocular systems or any eye camera for monocular system) eye_center0_3d_y : y center of eye-ball 0 eye_center0_3d_z : z center of eye-ball 0 gaze_normal0_x : x normal of the visual axis for eye 0 in the world camera coordinate system (of eye 0 for binocular systems or any eye for monocular system). The visual axis goes through the eye ball center and the object thats looked at. gaze_normal0_y : y normal of the visual axis for eye 0 gaze_normal0_z : z normal of the visual axis for eye 0 eye_center1_3d_x : x center of eye-ball 1 in the world camera coordinate system (not avaible for monocular setups.) eye_center1_3d_y : y center of eye-ball 1 eye_center1_3d_z: z center of eye-ball 1 gaze_normal1_x : x normal of the visual axis for eye 1 in the world camera coordinate system (not avaible for monocular setups.). The visual axis goes through the eye ball center and the object thats looked at. gaze_normal1_y : y normal of the visual axis for eye 1 gaze_normal1_z : z normal of the visual axis for eye 1<b>eyetracker / raw_data / imu_data</b>For each experiment course and participant there is a file _-imu_data.csv in csv format with the following columns: imu_timestamp : timestamp of the sample world_index : index of closest world video frame (world videos are not included with this data set) gyro_x : rotation speed around x in degrees/s gyro_y : rotation speed around y in degrees/s gyro_z : rotation speed around z in degrees/s accel_x : translational acceleration along the x in G (1 G = 9.80665 m/s^2) accel_y : translational acceleration along the y in G accel_z : translational acceleration along the z in G pitch : drift-free estimation of the pitch (head tilt from front to back) in degrees. The output range is -180 to +180 degrees. roll : drift-free estimation of the roll (head tilt from side to side) in degrees. The output range is -180 to +180 degrees.<b>eyetracker / sync_data</b>For each experiment course and participant there is a file eyetracker__.csv in csv format with the following columns: time : experiment time stamp syncronized with data in [1] et_timestamp : IMU timestamp of the sample et_gyro_x : rotation speed around x in degrees/s et_gyro_y : rotation speed around y in degrees/s et_gyro_z : rotation speed around z in degrees/s et_acceleration_x : translational acceleration along the x in G (1 G = 9.80665 m/s^2) et_acceleration_y : translational acceleration along the y in G et_acceleration_z : translational acceleration along the z in G et_pitch : drift-free estimation of the pitch (head tilt from front to back) in degrees. The output range is -180 to +180 degrees. et_roll : drift-free estimation of the roll (head tilt from side to side) in degrees. The output range is -180 to +180 degrees. gaze_confidence : computed gaze position confidence between 0 (not confident) -1 (confident) gaze_norm_pos_x : x position in the world image frame in normalized coordinates gaze_norm_pos_y : y position in the world image frame in normalized coordinatesNOTEThe inertial measurement unit (IMU) is integrated into the right temple of the Pupil Invisible glasses. It is oriented in the frame, such that the x-axis points to the right, the y-axis points downwards and the z-axis points to the front. Gaze data is output in pixel space of the scene camera image, which has a resolution of 1088x1080px. The origin is in the top-left corner of the image. Cf. PupilLabs Invisible documentationREFERENCES[1] Losing, V., Hasenjäger, M.(2022). NEWBEE: A Multi-Modal Gait Database of Natural Everyday-Walk in an Urban Environment. figshare. Collection. doi: 10.6084/m9.figshare.c.5758997.v1[2] Losing, V., &amp; Hasenjäger, M. (2022). A multi-modal gait database of natural everyday-walk in an urban environment. Scientific Data, 9(1), 473. doi: 10.1038/s41597-022-01580-3<br>