DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Dataset

Dataset for the DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Challenge More information about the challenge and challenge registration can be found on the challenge platform! Timeline: 8th January 2024: First subset of training & validation data available (scenes 0000-0009). 22nd January 2024: Second subset of training & validation data available (scenes 0010-0049). 26th January 2024: Full training & validation data available (scenes 0050-0100). Description: The dataset was created using Unreal Engine 5.1, Unreal MetaHumans, 3D-COSI surgical instruments, POV-Surgery grasp generation and EasySynth. Each scene contains: "color": RGB input images "gt": RGB ground truth images "mask": Mask defining the area to be inpainted. White -> Background, Black -> Inpainting area "CameraPoses.csv": Camera poses "CameraRig.json": Camera intrinsics To cite the dataset, please use @online{gsaxner_2024_10570773, author = {Gsaxner, Christina and van Meegdenburg, Timo and Luijten, Gijs and Vu, Viet Duc and Puladi, Behrus and Egger, Jan}, title = {{DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Dataset}}, month = jan, year = 2024, publisher = {Zenodo}, doi = {10.5281/zenodo.10570773}, url = {https://doi.org/10.5281/zenodo.10570773} }本数据集为DREAMING挑战赛——基于图像修复的医疗新兴应用消隐现实（Diminished Reality for Emerging Applications in Medicine through Inpainting Challenge）所用数据集。有关该挑战赛及赛事注册的更多详情，请登录挑战赛平台查询。 时间线： 2024年1月8日：开放训练与验证数据集第一子集（场景编号0000-0009）。 2024年1月22日：开放训练与验证数据集第二子集（场景编号0010-0049）。 2024年1月26日：开放完整训练与验证数据集（场景编号0050-0100）。 数据集说明： 本数据集基于虚幻引擎5.1（Unreal Engine 5.1）、虚幻MetaHumans（Unreal MetaHumans）、3D-COSI手术器械、POV-Surgery抓取生成工具及EasySynth构建。 每个场景包含以下内容： - `color`：RGB输入图像 - `gt`：RGB真值（Ground Truth）图像 - `mask`（掩码）：用于定义图像修复区域的掩码图，其中白色代表背景区域，黑色代表待修复区域 - `CameraPoses.csv`：相机位姿文件 - `CameraRig.json`：相机内参文件 如需引用本数据集，请使用以下参考文献格式： @online{gsaxner_2024_10570773, author = {Gsaxner, Christina and van Meegdenburg, Timo and Luijten, Gijs and Vu, Viet Duc and Puladi, Behrus and Egger, Jan}, title = {{DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Dataset}}, month = jan, year = 2024, publisher = {Zenodo}, doi = {10.5281/zenodo.10570773}, url = {https://doi.org/10.5281/zenodo.10570773} }