Plenoptic 2.0 - RayTrix R8 and RayTrix R32 - Stereo View Video Sequence: TempleBoatGiant

The test sequence "Plenoptic 2.0 - RayTrix R8 and RayTrix R32 - Stereo View Video Sequence: TempleBoatGiant" is provided by Sarah Fachada, Daniele Bonatto, Jaime Sancho, Gauthier Lafruit,Mehrdad Teratani, and Eduardo Juárez, members of the LISA department, EPB (Ecole Polytechnique de Bruxelles), ULB (Université Libre de Bruxelles), Belgium and CITSEM (Centro de Investigación en Tecnologías Software y Sistemas Multimedia para la Sostenibilidad), UPM (Universidad Politecnica de Madrid), Spain.

License:

CC BY-NC-SA

Terms of Use:

Any kind of publication or report using this sequence should refer to the following references:

[1] **Sarah Fachada, Daniele Bonatto, Jaime Sancho, Gauthier Lafruit, Mehrdad Teratani and Eduardo Juárez, "Plenoptic 2.0 - RayTrix R8 and RayTrix R32 - Stereo View Video Sequence: TempleBoatGiant," 2024.07, 10.5281/zenodo.12663777.**

@misc{fachada_templeboatgiantvideo_2024,

     title = {{Plenoptic} 2.0 {Raytrix} {R8} and {Raytrix} {R32} - {Stereo} {View} {Video} {Sequence}:  {TempleBoatGiant}},

     author = {Fachada, Sarah and Bonatto, Daniele and Sancho, Jaime and Lafruit, Gauthier and Teratani, Mehrdad and Juárez, Eduardo},

     month = jul,

     year = {2024},

     doi = {10.5281/zenodo.12663777}

}

[2] **Sarah Fachada, Daniele Bonatto, Jaime Sancho, Gauthier Lafruit, Mehrdad Teratani and Eduardo Juárez, "[LVC] A New Plenoptic 2.0 - RayTrix R8 and RayTrix R32 - Stereo View Video Sequence: TempleBoatGiant [M68363]," 2024.07, Sapporo, Japan, ISO/IEC JTC1/SC29/WG04**

@article{fachada_lvc_templeboatgiantvideo_2024,

     title = {{[LVC]} a {New} {Plenoptic} 2.0 {Raytrix} {R8} and {Raytrix} {R32} - {Stereo} {View} {Video} {Sequence}:  {TempleBoatGiant}},

     author = {Fachada, Sarah and Bonatto, Daniele and Sancho, Jaime and Lafruit, Gauthier and Teratani, Mehrdad and Juárez, Eduardo},

     month = jul,

     year = {2024},

    address = {Sapporo, Japan},

    edition = {MPEG2021/M68363},

    journal = {ISO/IEC JTC1/SC29/WG04}

}

Production:

Laboratory of Image Synthesis and Analysis, LISA department, Ecole Polytechnique de Bruxelles, Université Libre de Bruxelles, Belgium,

Centro de Investigación en Tecnologías Software y Sistemas Multimedia para la Sostenibilidad, CITSEM, Universidad Politécnica de Madrid, Spain.

Content:

This dataset contains a dynamic scene representing an artistic view of a boat floating on an ocean made of colored blocks, near a temple, while a giant is chasing them. The boat is animated by a giant wooden hand. The dataset is in the format of plenoptic images extracted from Raytrix [1] .rays files. The dataset was acquired with two Raytrix cameras, the R8 and the R32, mounted on the UPM’s robotic bench, keeping the same positon during the video. The distance transformation between the two Total Focus cameras is T= (193.968, 6.13558, 126.865) (mm), R= (-2.7386289,  -11.0520427,  1.479145) (°). The main lens focal length focals are F=25 for the R8 and F=50 for the R32.

The dataset additionally contains calibration images of a checkerboard with square size of 12mm.

1. **Scene**

300 frames of processed images extracted from .ray file.

Total focus videos

2. **Calibration images:**

Processed and raw views of a checkerboard with 12mm square size.

Raw gray images to extract the processed image.

MLA Calibration files are provided in XML format.

The dataset contains:

- `video_{R32/R8}` folders containing:

Processed plenoptic PNG files

XML MLA calibration files

Total focus MP4 videos extracted with RxLive software for visualization of the scene.

- A `checkerboard` folder containing:

XML MLA calibration files

8 Plenoptic raw images in PNG format of a checkerboard with square size of 12mm

8 Plenoptic processed images in PNG format of the checkerboard

Gray images in PNG for raw file processing.

References and links:

[1] https://raytrix.de/

Acknowledgments:

Sarah Fachada is a Postdoctoral Researcher of the Fonds de la Recherche Scientifique - FNRS, Belgium.

This work was supported in part by the HoviTron project (no. 951989), the FER 2021 project (no. 1060H000066-FAISAN), the Emile DEFAY 2021 project (no. 4R00H000236), and the FER 2023 project (no. 1060H000075).

Additionally, this work has been funded by the project AIMS5.0, supported by the Chips Joint Undertaking and its members, including top-up funding by National Funding Authorities from involved countries (no. 101112089), and the European project STRATUM (no. 101137416). The robotic bench was funded by “Programa Propio UPM” in the call “convocatoria de ayudas a centros e institutos de I+D+i”.