Impact of delayed response on Wearable Cognitive Assistance

This dataset contains the data associated with our research project titled Impact of delayed response on Wearable Cognitive Assistance. A preprint of the associated paper can be found at https://arxiv.org/abs/2011.02555. -------------------<br> GENERAL INFORMATION<br> ------------------- 1. Title of Dataset: Impact of delayed response on Wearable Cognitive Assistance 2. Author Information First Author Contact Information<br> Name: Manuel Olguín Muñoz<br> Institution: School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology<br> Address: Malvinas väg 10, Stockholm 11428, Sweden<br> Email: [e-mail]<br> Phone Number: [phone]<br> <br> Author Contact Information<br> Name: Roberta L. Klatzky<br> Institution: Department of Psychology, Carnegie Mellon University<br> Address: 5000 Forbes Ave, Pittsburgh, PA 15213<br> Email: [e-mail]<br> Phone Number: [phone] Author Contact Information<br> Name: Mahadev Satyanarayanan<br> Institution: School of Computer Science, Carnegie Mellon University<br> Address: 5000 Forbes Ave, Pittsburgh, PA 15213<br> Email: [e-mail]<br> Phone Number: [phone] Author Contact Information<br> Name: James R. Gross<br> Institution: School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology<br> Address: Malvinas väg 10, Stockholm 11428, Sweden<br> Email: [e-mail]<br> Phone Number: [phone] <br> ---------------------<br> DATA &amp; FILE OVERVIEW<br> --------------------- Directory of Files:<br> A. Filename: accelerometer_data.csv<br> Short description: Time-series accelerometer data. Each row corresponds to a sample. B. Filename: block_aggregate.csv<br> Short description: Contains the block- and slice-level aggregates for each of the metrics and statistics present in this dataset. Each row corresponds to either a full block or a slice of a block, see below for details. C. Filename: block_metadata.csv<br> Short description: Contains the metadata for each block in the task for each participant. Each row corresponds to a block.<br> <br> D. Filename: bvp_data.csv<br> Short description: Time-series blood-volume-pulse data. Each row corresponds to a sample. E. Filename: eeg_data.csv<br> Short description: Time-series electroencephalogram data, represented as power per band. Each row corresponds to a sample; power was calculated in 0.5 second intervals. F. Filename: frame_metadata.csv<br> Short description: Contains the metadata for each video frame processed by the cognitive assistant. Each row corresponds to a processed frame. G. Filename: gsr_data.csv<br> Short description: Time-series galvanic skin response data. Each row corresponds to a sample. H. Filename: task_step_metadata.csv<br> Short description: Contains the metadata for each step in the task for each participant. Each row corresponds to a step in the task. I. Filename: temperature_data.csv<br> Short description: Time-series thermometer data. Each row corresponds to a sample. <br> Additional Notes on File Relationships, Context, or Content<br> (for example, if a user wants to reuse and/or cite your data,<br> what information would you want them to know?): - The data contained in these CSVs was obtained from 40 participants in a study performed with approval from the Carnegie Mellon University Institutional Research Board. In this study, participants were asked to interact with a Cognitive Assistant while wearing an array of physiological sensors. The data contained in this dataset corresponds to the actual collected data, after some preliminary preprocessing to convert from sensors readings into meaningful values. - Participants have been anonymized using random integer identifiers. - block_aggregate.csv can be replicated by cross-referencing the start and end timestamps of each block in block_metadata.csv and the timestamps for each desired metric. - The actual video frames mentioned in frame_metadata.csv are not included in the dataset since their contents were not relevant to the research. File Naming Convention: N/A -----------------------------------------<br> DATA DESCRIPTION FOR: accelerometer_data.csv<br> ----------------------------------------- <br> 1. Number of variables: 7 2. Number of cases/rows: 1844688 3. Missing data codes: N/A 4. Variable list: A. Name: timestamp<br> Description: Timestamp of the sample. B. Name: x<br> Description: Acceleration reading from the x-axis of the accelerometer in g-forces [g]. C. Name: y<br> Description: Acceleration reading from the y-axis of the accelerometer in g-forces [g].<br> <br> D. Name: z<br> Description: Acceleration reading from the z-axis of the accelerometer in g-forces [g]. E. Name: ts<br> Description: Time difference with respect to first sample. F. Name: participant<br> Description: Denotes the numeric ID representing each individual participant. G. Name: delay<br> Description: Delay that was being applied on the task when this reading was obtained in time delta format. -----------------------------------------<br> DATA DESCRIPTION FOR: block_aggregate.csv<br> ----------------------------------------- 1. Number of variables: 16 2. Number of cases/rows: 2520 3. Missing data codes:<br> - Except for the 'slice' columns, empty cells mean that the data is not applicable or was removed from the dataset due to noise or instrument failure.<br> - For the 'slice' column, a missing value indicates that the row corresponds to the whole block as opposed to a slice of it. 4. Variable List: A. Name: participant<br> Description: Denotes the numeric ID representing each individual participant. B. Name: block_seq<br> Description: Denotes the position of the block in the task. Ranges from 1 to 21. C. Name: slice<br> Description: Index of the 4-step slice of the block over which the data was aggregated. Ranges from 0 to 2, however higher values are only applicable for blocks of appropriate length (i.e. blocks of length 4 only have a 0-slice, length 8 have 0 and 1, and length 12 have slices from 0 to 2). A missing value indicates that this row instead contains aggregate values for the whole block. D. Name: block_length<br> Description: Length of the block. Valid values are 4, 8 and 12. C. Name: block_delay<br> Description: Delay applied to the block, in seconds. F. Name: start<br> Description: Timestamp marking the start of the block or slice. G. Name: end<br> Description: Timestamp marking the end of the block or slice. H. Name: duration<br> Description: Duration of the block or slice, in seconds. I. Name: exec_time_per_step_mean<br> Description: Mean execution time for each step in the block or slice. J. Name: bpm_mean<br> Description: Mean heart rate, in beats-per-minute, for the block or slice. K. Name: bpm_std<br> Description: Standard deviation of the heart rate, in beats-per-minute, for the block or slice. L. Name: gsr_per_second<br> Description: Galvanic skin response in microsiemens, summed and then normalized by block or slice duration. M. Name: movement_score<br> Description: Movement score for the block or slice. The movement score is calculated as the sum of the magnitude of all the acceleration vectors in the block or slice, divided by duration in seconds. N. Name: eeg_alpha_log_mean<br> Description: Log of the average EEG power for the alpha band for the, block or slice. O. Name: eeg_beta_log_mean<br> Description: Log of the average EEG power for the beta band for the, block or slice. P. Name: eeg_total_log_mean<br> Description: Log of the average EEG power for the complete EEG signal, for the block or slice. -----------------------------------------<br> DATA DESCRIPTION FOR: block_metadata.csv<br> ----------------------------------------- 1. Number of variables: 8 2. Number of cases/rows: 880 3. Missing data codes: N/A 4. Variable list: A. Name: participant<br> Description: Denotes the numeric ID representing each individual participant. B. Name: seq<br> Description: Index of the block in the task, ranging from 0 to 21. Note that block 0 is not to be included in aggregate calculations. C. Name: length<br> Description: Length of the block in number of steps. D. Name: delay<br> Description: Delay applied to the block. E. Name: start<br> Description: Timestamp marking the start of the block. F. Name: end<br> Description: Timestamp marking the end of the block. G. Name: duration<br> Description: Duration of the block as a timedelta. H. Name: exec_time<br> Description: Execution time of the block as a timedelta. -----------------------------------------<br> DATA DESCRIPTION FOR: bvp_data.csv<br> ----------------------------------------- 1. Number of variables: 8 2. Number of cases/rows: 3683504 3. Missing data codes: Columns bpm and ibi only contain values for rows corresponding to a sample taken at a heartbeat. 4. Variable list: A. Name: ts<br> Description: Time difference with respect to first sample. B. Name: timestamp<br> Description: Timestamp of the sample. C. Name: bvp<br> Description: Blood-volume-pulse reading, in millivolts. D. Name: onset<br> Description: Boolean indicating if this sample corresponds to the onset of a pulse. E. Name: bpm<br> Description: Instantaneous beat-per-minute value. F. Name: ibi<br> Description: Instantaneous inter-beat-interval value. G. Name: delay<br> Description: Delay that was being applied on the task when this reading was obtained in time delta format. H. Name: participant<br> Description: Denotes the numeric ID representing each individual participant. -----------------------------------------<br> DATA DESCRIPTION FOR: eeg_data.csv<br> ----------------------------------------- 1. Number of variables: 16 2. Number of cases/rows: 114169 3. Missing data codes: N/A 4. Variable list: A. Name: ts<br> Description: Time difference with respect to first sample. B. Name: delta_0<br> Description: Power in the delta band, measured at Fp1 (left temple). C. Name: theta_0<br> Description: Power in the theta band, measured at Fp1 (left temple). D. Name: alpha_0<br> Description: Power in the alpha band, measured at Fp1 (left temple). E. Name: beta_0<br> Description: Power in the beta band, measured at Fp1 (left temple). F. Name: gamma_0<br> Description: Power in the gamma band, measured at Fp1 (left temple). G. Name: total_0<br> Description: Total power in the signal captured by the electrode at Fp1 (left temple). H. Name: delta_1<br> Description: Power in the delta band, measured at Fp2 (right temple). I. Name: theta_1<br> Description: Power in the theta band, measured at Fp2 (right temple). J. Name: alpha_1<br> Description: Power in the alpha band, measured at Fp2 (right temple). K. Name: beta_1<br> Description: Power in the beta band, measured at Fp2 (right temple). L. Name: gamma_1<br> Description: Power in the gamma band, measured at Fp2 (right temple). M. Name: total_1<br> Description: Total power in the signal captured by the electrode at Fp2 (right temple). N. Name: timestamp<br> Description: Timestamp of the sample. O. Name: delay<br> Description: Delay that was being applied on the task when this reading was obtained in time delta format. P. Name: participant<br> Description: Denotes the numeric ID representing each individual participant. -----------------------------------------<br> DATA DESCRIPTION FOR: frame_metadata.csv<br> ----------------------------------------- 1. Number of variables: 6 2. Number of cases/rows: 116841 3. Missing data codes: N/A 4. Variable list: A. Name: seq<br> Description: Absolute sequence number of the frame. Not contiguous, as frames were captured at 24 FPS but processing was only able to achieve around 15 FPS at best, so a large number of frames were dropped and not included in this dataset. B. Name: submitted<br> Description: Timestamp marking when the frame was submitted to the application for processing. C. Name: processed<br> Description: Timestamp marking when processing for the frame finished. D. Name: returned<br> Description: Timestamp marking when the result of processing was presented to the user. E. Name: result<br> Description: Result of the processing of the frame. Possible values:<br> - CV_ERROR: Frame was discarded due to image processing failure (e.g. because the LEGO board was not visible).<br> - JUNK_FRAME: Similar to CV_ERROR. Processing succeeded but frame included no usable information. Frame was discarded.<br> - NO_CHANGE: Processing succeeded, but frame was detected as capturing the exact same task state as the previous SUCCESS frame. Frame was discarded.<br> - LOW_CONFIDENCE: Processing succeeded but CV algorithm had low confidence as to the captured task state. Frame was discarded.<br> - SUCCESS: Processing succeeded and a correct task state was detected. A new instruction was generated and presented to the user.<br> - TASK_ERROR: Processing succeeded, but detected task state was incorrect. A corrective instruction was generated and presented to the user.<br> F. Name: participant<br> Description: Denotes the numeric ID representing each individual participant. -----------------------------------------<br> DATA DESCRIPTION FOR: gsr_data.csv<br> ----------------------------------------- 1. Number of variables: 8 2. Number of cases/rows: 230172 3. Missing data codes: Column amplitude only contains values for rows corresponding to peaks. 4. Variable list: A. Name: timestamp<br> Description: Timestamp of the sample. B. Name: ts<br> Description: Time difference with respect to first sample. C. Name: gsr<br> Description: Raw GSR reading in microsiemens. D. Name: peak<br> Description: Boolean indicating if the sample corresponds to a peak in the GSR signal or not. E. Name: onset<br> Description: