DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Dataset

Dataset for the DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Challenge More information about the challenge can be found on the challenge website! Timeline: 8th January 2024: First subset of training & validation data available (scenes 0000-0009). 22nd January 2024: Second subset of training & validation data available (scenes 0010-0049). 29th January 2024: Full training & validation data available (scenes 0050-0100). Description: The dataset was created using Unreal Engine 5.1, Unreal MetaHumans, 3D-COSI surgical instruments, POV-Surgery grasp generation and EasySynth. Each scene contains: "color": RGB input images "gt": RGB ground truth images "mask": Mask defining the area to be inpainted. White -> Background, Black -> Inpainting area "CameraPoses.csv": Camera poses "CameraRig.json": Camera intrinsics