Segmentation and alignment of grapevine leaf veins and lobes in a rotationally invariant space using the Euler Characteristic Transform

A model to segment major primary veins and lobes in grapevine leaves. The model requires segmented RGB leaf masks, the coordinate location of the petiolar junction, and the corresponding radial Euler Characteristic Transform (ECT) of the segmented leaf outline. Using the petiolar junction as the origin, the model transforms the leaf into a polar coordinate space, transforming rotational variance into translational variance that is better handled by the model. The segmented pixel identities are used to align leaves. Segmented and aligned leaves are converted back into a Cartesian space. Code using this model to infer on nearly 25K grapevine leaves the segmentation of veins and lobes can be found at:Prediction of veins and lobes on nearly 25K grapevine leaves: https://zenodo.org/records/18057298 The inferred results can be downloaded at:Inferred veins and lobes on nearly 25K grapevine leaves: https://zenodo.org/records/18057441 The following shows the history of models leading to this one. The models below are primarily used to predict the petiolar junction (which only requires prediction of the full and primary vein masks), which is used as the foundational input for this model. Segmentation of RGB leaf masks LEAF_SEGMENTATION: https://zenodo.org/records/16883916 FINAL_MASKS: https://zenodo.org/records/16883403 Segmentation of full vein mask Vein segmentation of pre-segmented grapevine leaves using the radial Euler Characteristic Transform: https://zenodo.org/records/17741713 Segmentation of primary veins Primary vein segmentation in grapevine leaves: https://zenodo.org/records/17881166 Segmentation of midvein Midvein segmentation of grapevine leaves: https://zenodo.org/records/18005383 Gaussian heatmap estimation of petiolar junction coordinate Grapevine leaf petiolar junction detection: https://zenodo.org/records/17922822 Segmentation of midvein, distal, and proximal lobes Grapevine leaf lobe detection model: https://zenodo.org/records/18004938