TULIP-Bench: Multi-perspective videos and 3D poses capturing multi-task Parkinson's disease assessments and deep brain stimulation treatment effects

Notice for Authorized Reviewers — Private Access LinkThis private access link has been generated solely for the purpose of reviewing this academic submission to NeurIPS 2026. The record is publicly accessible, but files are restricted to users with access. You are receiving private access links to enable review of the dataset for academic purposes only. Only access the dataset if you (1) agree to use the dataset only for the purpose of reviewing this academic product, and (2) accept the following license agreement. By downloading any file from this repository using this link, you agree to the following conditions, which constitute a legally binding data use agreement :

You will use the data exclusively for the purpose of reviewing this academic submission and for no other purpose.

You will not redistribute, share, publish, or transmit this link or any downloaded files to any third party.

You will delete all downloaded files upon completion of the review process.

You will not attempt to re-identify any individuals in the dataset.

You will not use the data for commercial purposes.

This dataset, and any copyrights therein, are owned by Duke University. You agree to an open license under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BYNC-ND 4.0) license: https://creativecommons.org/licenses/by-nc-nd/4.0/. Outside contributions to the Duke-owned dataset cannot be accepted unless the contributor assigns copyrights to any modifications, changes, and/or derivatives over to Duke University. Please note that this dataset is distributed AS IS, WITHOUT ANY WARRANTY; and without the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Downloading any file constitutes your acceptance of these terms.

-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------

TULIP-Bench is a multi-camera Parkinson's disease (PD) movement dataset combining synchronized RGB videos and triangulated 3D pose sequences across bilateral fist closure (hand movement, MDS-UPDRS Item 3.5) and gait (MDS-UPDRS Item 3.10) activities, released alongside the paper "Multi-Perspective Video Analysis for Parkinson's Disease Severity Prediction and Treatment Response Detection" (submitted to NeurIPS 2026 Evaluations and Datasets Track).

Cohorts

Observational cohort (normal_PD, N=56 PD patients): Multi-camera recordings of bilateral fist closure (hand movement) and gait at self-selected pace. Each activity has an independent MDS-UPDRS score rated by a licensed movement disorder specialist.

Neurostimulation (Deep Brain Stimulation, DBS) cohort (N=10 subjects, N=20 recordings total for DBS-ON/OFF): Separately recruited patients recorded performing gait in both stimulation OFF (after 10-minute washout) and stimulation ON (after confirmed stable clinical effect) states. Includes per-state UPDRS Gait scores and structured body-part severity annotations (arm swing L/R, stride L/R, elbow flexion L/R).

Recording setup: Six hardware-synchronized Basler cameras (acA1920-155uc, 1920x1200, 80 fps). Layout: Camera 5 (front-facing), Camera 4 (ceiling bird's-eye), Cameras 1, 2, 3, 6 (four elevated corner views). For gait, only Cameras 1, 2, 3, 6 are released; Camera 1 is the designated monocular baseline view. All 6 cameras released for fist activities. Calibrated using OpenCV with a charucoboard pattern.

Dataset structure

Fist_Video.zip: Face-blurred MP4 videos, FistL & FistR, 6 cameras, 56 subjects; 30 seconds with 80fps

Fist_Pose_3D.zip: Triangulated 3D hand poses (2400x21x3, mm; MediaPipe Hand 21-keypoint convention, recommend excluding first 3s to remove hand-raising phase)

Fist_Camera_parameters.zip: Per-subject 3x4 projection matrices (P = K @ [R|t]), Camera 1-6

Fist_labels.csv: MDS-UPDRS Item 3.5 scores (UPDRS_Fist_L, UPDRS_Fist_R)

Gait_Videos.zip: Face-blurred MP4 videos, Gait for normal PD (56 subjects), & Gait_DBS (10 subjects with N=20 recordings total for ON/OFF), 4 cameras-Cameras 1, 2, 3, 6; 90 seconds with 80fps

Gait_Pose_3D.zip: Triangulated 3D body poses (7200x33x3, mm; 17-keypoint MediaPipe subset per paper)

Gait_Camera_parameters.zip: Per-subject 3x4 projection matrices, all 6 cameras stored (Cameras 4 and 5 included in pkl but videos not released for gait)

Gait_normalPD_labels.csv: MDS-UPDRS gait scores, for observational cohort

Gait_DBS_labels.csv: MDS-UPDRS and body-part severity labels, for DBS cohort

Access is restricted to academic researchers. Please submit a request via the form below and provide your institutional affiliation and intended use.

IRB approval: Pro00112856 and Pro00116644.

All participants provided written informed consent.