We propose a novel deep learning algorithm, denoted as Deep Optical Flow (DoF), capable of interpreting and predicting cell behaviors with high accuracy in time-lapse fluorescence images. DoF has dual pipeline networks, including 4D-Rank convolution operations. One classifies the behavior of induvial cells while generating Optical Flow for the cells, whereas another predicts the next few frames of cells. DoF was verified with our and public datasets for cell tracking, segmentation, and identification. The experimental results demonstrate that DoF outperformed other state-of-the-arts in the analysis of cell behaviors. Therefore, these suggested that DoF has the potentials to become a novel tool for a better understanding of cell behaviors.
|