Data from: Trade-offs in Coordination Strategies for Networked Jazz Performances (anonymized for peer review)

This dataset is associated with the paper “Trade-offs in Coordination Strategies for Networked Jazz Performances” and includes recordings of improvisations by jazz duos over a network.

Introduction:

This dataset includes data from approximately four hours of live, improvised musical duo performances over a simulated network environment collected in LOCATION REMOVED FOR PEER REVIEW. Data includes audio and video recordings of 130 individual performances, biometric data, and subjective evaluations and comments from the musicians. The primary aim of the project was to collect data via a novel performance capture and manipulation system for use in the empirical modelling of ensemble coordination strategies during networked music-making. This analysis is reported in ANONYMIZED FOR PEER REVIEW. Please refer to this publication for full details on the data collection procedure.

The ten musicians shown in these recordings were recruited for their expertise in jazz improvisation. They were grouped into five duos consisting each of one pianist and drummer, with no musician performing in more than one duo. Participants were instructed to improvise together over a standard twelve-bar blues musical structure, but following a formula which required them to provide a clear and unambiguous pulse of continuous quarter notes. Varying amounts of network latency and jitter were simulated for each performance, consisting respectively of the minimum amount of delay applied to the live feedback a musician heard from their partner and the degree that this delay varied. The amount of latency and jitter applied to the performance is summarised in the file or directory name for each performance and is described in detail in the above publication. Note that latency and jitter conditions were presented in a random order for each duo.

Data collected includes:

audio recordings for each performance, with and without delay, collected via direct line-in (MIDI, WAV).

video recordings, collected via high-quality webcams (MKV, AVI).

streams of the quarter note pulse provided by each musician in a performance (MIDI).

muxed audio-visual recordings of both participants in each performance (MP4)

accelerometer and photoplethysmography streams, collected from arm-worn devices (TXT, duos 3-5 only)

questionnaire responses from performers, evaluating each condition (XLSX)

ratings of performance quality from an unbiased sample of listeners, collected during an online perceptual study (CSV)

Repository structure:

NB: please see this section of the code documentation website (LINK REMOVED FOR PEER REVIEW) for a full description of how to recreate the analyses and models created in the paper.

The files data.zip and data.z0* contain all data collected from the study, APART from the perceptual study stimuli & results. To open these files, download the data.zip file and all the corresponding volumes ending in .z0 and open the data.zip file using a tool for opening multi-part zip files, such as WinRAR. Do not try to open the files ending in .z0, otherwise you may get a message about the data being corrupted. Inside data.zip, you'll see the following folders and files:

avmanip_output: the raw MIDI, audio, and video output from each performance

the subfolders are organised with a single folder per participant duo, experimental block, and condition.

avmanip_output\trial_1\Block 1\Condition 1 - 23 05 relates to the performance of the first duo of participants in the first session of the experiment, in the first condition they encountered, with 23ms of latency and 0.5x jitter.

midi_bpm_cleaning: the cleaned MIDI files (quarter note onset positions)

the subfolders are organised similarly to the avmanip_output folder, using the same conventions.

muxed_performances: the combined audio-video .mp4 files from each performance

these files are labelled in the format: duo_session_latency_jitter_keysfmt_drumsfmt.

muxed_performances\kdelay_ddelay\d1_s1_l23_j00_kdelay_ddelay.mp4 relates to the performance of the first duo of participants in the first session of the experiment, in the first condition they encountered, with 23ms of latency and 0.5x jitter, and with latency and jitter applied to both keys and drummer.

for more information on recreating these videos, see the linked section of the code documentation website (LINK REMOVED FOR PEER REVIEW).

questionnaire_anonymized: the anonymized questionnaire responses given by participants, also contained in the supplementary material of the associated paper (see preprint).

Alongside data.zip and the data.z0* archives, there are two further loose files, Database View Participant - Dashboard.csv, Database View SuccessTrial - Dashboard.csv, which are the anonymized demographic and response data from the perceptual experiment, and one loose archive folder perceptual_study_videos.rar, which contains the stimuli used in the perceptual experiment.

Usage:

To reproduce the analysis, models, and graphs from the paper, download the code in code-analysis-modeling.rar and extract it to a new folder, then extract all the files inside data.zip and the two perceptual study CSV files into \data\raw. Install Python 3.10 if you don't have it already, and then open a command prompt in the root directory of the analysis code and execute the command run.cmd.

The remaining code files (code-perceptual-study.rar and code-testbed-software.rar) contain the code used in the perceptual and laboratory experiments. Documentation and installation instructions are provided within each archive.

These recordings of live, improvised duo performances are unattributed and anonymized as agreed with participants at the point of data collection. The musicians involved received a one-off, fixed payment for their time and had their travel expenses reimbursed, with funding provided by ANONYMIZED FOR PEER REVIEW. All participants consented to the use of their recordings for projects by the current authors and for these recordings to be shared with interested members of the music psychology community, with the intention of furthering academic research. The musicians did not intend that the recordings be used for commercial, artistic, or entertainment purposes, and such use is not permitted.

Citation:

If you use this dataset in your research, please follow the citation format posted on GitHub (LINK REMOVED FOR PEER REVIEW).

Contact:

ANONYMIZED FOR PEER REVIEW