FBN: Weakly Supervised Thyroid Nodule Segmentation Optimized by Online Foreground and Background

Objective: The main objective of the work described here was to train a semantic segmentation model using classifi-cation data for thyroid nodule ultrasound images to reduce the pressure of obtaining pixel-level labeled data sets. Furthermore, we improved the segmentation performance of the model by mining the image information to narrow the gap between weakly supervised semantic segmentation (WSSS) and fully supervised semantic segmentation.Methods: Most WSSS methods use a class activation map (CAM) to generate segmentation results. However, the lack of supervision information makes it difficult for a CAM to highlight the object region completely. Therefore, we here propose a novel foreground and background pair (FB-Pair) representation method, which consists of high-and low-response regions highlighted by the original CAM-generated online in the original image. During training, the original CAM is revised using the CAM generated by the FB-Pair. In addition, we design a self-super-vised learning pretext task based on FB-Pair, which requires the model to predict whether the pixels in FB-Pair are from the original image during training. After this task, the model will accurately distinguish between differ-ent categories of objects.Results: Experiments on the thyroid nodule ultrasound image (TUI) data set revealed that our proposed method outperformed existing methods, with a 5.7% improvement in the mean intersection-over-union (mIoU) perfor-mance of segmentation compared with the second-best method and a reduction to 2.9% in the difference between the performance of benign and malignant nodules.Conclusion: Our method trains a well-performing segmentation model on ultrasound images of thyroid nodules using only classification data. In addition, we determined that CAM can take full advantage of the information in the images to highlight the target regions more accurately and thus improve the segmentation performance.

Automated summary

The objective of this work was to train a semantic segmentation model for thyroid nodule ultrasound images using classification data and improve the segmentation performance by mining image information. A novel foreground and background pair representation method was proposed, along with a self-supervised learning pretext task. Experiments showed that the proposed method outperformed existing methods and achieved accurate segmentation.