Automatic Segmentation of Cervical Nuclei Based on Deep learning and a Conditional Random Field

Automatic and accurate cervical nucleus segmentation is important because nuclei carry substantial diagnostic information for automatic computer-assisted cervical cancer screening and diagnosis systems. In this paper, we propose a cervical nucleus segmentation method in which pixel-level prior information is utilized to provide the supervisory information for the training of a mask regional convolutional neural network (Mask-RCNN), which is then employed to extract the multi-scale features of the nuclei, and the coarse segmentation and bounding box of the nuclei are obtained by forward propagation of the Mask-RCNN. To refine the segmentation, a local fully connected conditional random field (LFCCRF) that contains unary and pairwise energy terms is employed. The nuclear region of interest is determined by extending the bounding box, the coarse segmentation in the nuclear region is used to construct the unary energy, and the pairwise energy is contributed by the position and intensity information of all of the pixels in the nuclear region. By minimizing the energy of the LFCCRF, the final segmentation is realized. We evaluated our method by using cervical nuclei from the Herlev Pap smear data set in this paper, and the precision, recall, and Zijdenbos similarity index were all found to be greater than 0.95 with low standard deviations, demonstrating that our method enables more accurate and stable cervical nucleus segmentation than the current state-of-the-art methods.