ReSCU-Nets: recurrent U-Nets for segmentation of multidimensional microscopy data

Segmenting multi-dimensional microscopy data requires high accuracy across many images (e.g. timepoints) and is thus a labour-intensive part of biological image processing pipelines. We present ReSCU-Nets, recurrent convolutional neural networks that use the segmentation results from the previous frame as a prompt to segment the current frame. We demonstrate that ReSCU-Nets outperform state-of-the-art image segmentation models in different segmentation tasks on time-lapse microscopy sequences.

This study contains three datasets containing timelapse fluorescence microscopy videos of cell migration processes during Drosophila embryonic development, with accompanying ground truth segmentations. The first dataset shows the nuclei of cardioblasts as they migrate to form the early heart tube. The second and third datasets show epithelial cell outlines during embryonic wound healing. The second dataset provides ground truth segmentations of the wound itself, while the third dataset contains ground truth segmentations of cell areas around the wound.