3D Segmentation Guided Style-Based Generative Adversarial Networks for PET Synthesis

Potential radioactive hazards in full-dose positron emission tomography (PET) imaging remain a concern, whereas the quality of low-dose images is never desirable for clinical use. So it is of great interest to translate low-dose PET images into full-dose. Previous studies based on deep learning methods usually directly extract hierarchical features for reconstruction. We notice that the importance of each feature is different and they should be weighted dissimilarly so that tiny information can be captured by the neural network. Furthermore, the synthesis on some regions of interest is important in some applications. Here we propose a novel segmentation guided style-based generative adversarial network (SGSGAN) for PET synthesis. (1) We put forward a style-based generator employing style modulation, which specifically controls the hierarchical features in the translation process, to generate images with more realistic textures. (2) We adopt a task-driven strategy that couples a segmentation task with a generative adversarial network (GAN) framework to improve the translation performance. Extensive experiments show the superiority of our overall framework in PET synthesis, especially on those regions of interest.

Automated summary

This study presents a novel segmentation guided style-based generative adversarial network (SGSGAN) for PET synthesis, which utilizes a style-based generator with style modulation to control hierarchical features in the translation process to generate images with more realistic textures, and adopts a task-driven strategy by combining a segmentation task with a generative adversarial network (GAN) framework to enhance translation performance. Extensive experiments demonstrate the superiority of the overall framework in PET synthesis, especially on regions of interest.