Datasets for Evaluation of Multimodal Image Registration

<strong>Description</strong> <strong>Aerial data</strong> The Aerial dataset is divided into 3 sub-groups by IDs: {7, 9, 20, 3, 15, 18}, {10, 1, 13, 4, 11, 6, 16}, {14, 8, 17, 5, 19, 12, 2}. Since the images vary in size, each image is subdivided into the maximal number of equal-sized non-overlapping regions such that each region can contain exactly one 300x300 px image patch. Then one 300x300 px image patch is extracted from the centre of each region. The particular 3-folded grouping followed by splitting leads to that each evaluation fold contains 72 test samples. Modality A: Near-Infrared (NIR) Modality B: three colour channels (in B-G-R order) <strong>Cytological data</strong> The Cytological data contains images from 3 different cell lines; all images from one cell line is treated as one fold in 3-folded cross-validation. Each image in the dataset is subdivided from 600x600 px into 2x2 patches of size 300x300 px, so that there are 420 test samples in each evaluation fold. Modality A: Fluorescence Images Modality B: Quantitative Phase Images (QPI) <strong>Histological dataset</strong> For the Histological data, to avoid too easy registration relying on the circular border of the TMA cores, the evaluation images are created by cutting 834x834 px patches from the centres of the original 134 TMA image pairs. Modality A: Second Harmonic Generation (SHG) Modality B: Bright-Field (BF) The evaluation set created from the above three publicly available datasets consists of images undergone 4 levels of (rigid) transformations of increasing size of displacement. The level of transformations is determined by the size of the rotation angle θ and the displacement tx &amp; ty, detailed in this table. Each image sample is transformed exactly once at each transformation level so that all levels have the same number of samples. In total, it contains 864 image pairs created from the aerial dataset, 5040 image pairs created from the cytological dataset, and 536 image pairs created from the histological dataset. Each image pair consists of a reference patch \(I^{\text{Ref}}\) and its corresponding initial transformed patch \(I^{\text{Init}}\) in both modalities, along with the ground-truth transformation parameters to recover it. Scripts to calculate the registration performance and to plot the overall results can be found in https://github.com/MIDA-group/MultiRegEval, and instructions to generate more evaluation data with different settings can be found in https://github.com/MIDA-group/MultiRegEval/tree/master/Datasets#instructions-for-customising-evaluation-data. <strong>Metadata</strong> In the <code>*.zip</code> files, each row in <code>{Zurich,Balvan}_patches/fold[1-3]/patch_tlevel[1-4]/info_test.csv</code> or <code>Eliceiri_patches/patch_tlevel[1-4]/info_test.csv</code> provides the information of an image pair as follow: Filename: identifier(ID) of the image pair X1_Ref: x-coordinate of the upper-left corner of reference patch I_Ref Y1_Ref: y-coordinate of the upper-left corner of reference patch I_Ref X2_Ref: x-coordinate of the lower-left corner of reference patch I_Ref Y2_Ref: y-coordinate of the lower-left corner of reference patch I_Ref X3_Ref: x-coordinate of the lower-right corner of reference patch I_Ref Y3_Ref: y-coordinate of the lower-right corner of reference patch I_Ref X4_Ref: x-coordinate of the upper-right corner of reference patch I_Ref Y4_Ref: y-coordinate of the upper-right corner of reference patch I_Ref X1_Trans: x-coordinate of the upper-left corner of transformed patch I_Init Y1_Trans: y-coordinate of the upper-left corner of transformed patch I_Init X2_Trans: x-coordinate of the lower-left corner of transformed patch I_Init Y2_Trans: y-coordinate of the lower-left corner of transformed patch I_Init X3_Trans: x-coordinate of the lower-right corner of transformed patch I_Init Y3_Trans: y-coordinate of the lower-right corner of transformed patch I_Init X4_Trans: x-coordinate of the upper-right corner of transformed patch I_Init Y4_Trans: y-coordinate of the upper-right corner of transformed patch I_Init Displacement: mean Euclidean distance between reference corner points and transformed corner points RelativeDisplacement: the ratio of displacement to the width/height of image patch Tx: randomly generated translation in the x-direction to synthesise the transformed patch I_Init Ty: randomly generated translation in the y-direction to synthesise the transformed patch I_Init AngleDegree: randomly generated rotation in degrees to synthesise the transformed patch I_Init AngleRad: randomly generated rotation in radian to synthesise the transformed patch I_Init <strong>Naming convention</strong> <strong>Aerial Data</strong> <pre> zh{ID}_{iRow}_{iCol}_{ReferenceOrTransformed}.png</pre> Example: <code>zh5_03_02_R.png</code> indicates the <em>Reference </em>patch of the <em>3rd row</em> and <em>2nd column</em> cut from the image with ID <code>zh5</code>. <strong>Cytological data</strong> <pre> {{cellline}_{treatment}_{fieldofview}_{iFrame}}_{iRow}_{iCol}_{ReferenceOrTransformed}.png</pre> Example: <code>PNT1A_do_1_f15_02_01_T.png</code> indicates the <em>Transformed </em>patch of the <em>2nd row</em> and <em>1st column</em> cut from the image with ID <code>PNT1A_do_1_f15</code>. <strong>Histological data</strong> <pre> {ID}_{ReferenceOrTransformed}.tif</pre> Example: <code>1B_A4_T.tif</code> indicates the <em>Transformed </em>patch cut from the image with ID <code>1B_A4</code>. This dataset was originally produced by the authors of <em>Is Image-to-Image Translation the Panacea for Multimodal Image Registration? A Comparative Study</em>.