Improving generalization in MR-to-CT synthesis in radiotherapy by using an augmented cycle generative adversarial network with unpaired data

Purpose: MR-to-CT synthesis is one of the first steps in the establishment of an MRI-only workflow in radiotherapy. Current MR-to-CT synthesis methods in deep learning use unpaired MR and CT training images with a cycle generative adversarial network (CycleGAN) to minimize the effect of misalignment between paired images. However, this approach critically assumes that the underlying interdomain mapping is approximately deterministic and one-to-one. In the current study, we use an Augmented CycleGAN (AugCGAN) model to create a robust model that can be applied to different scanners and sequences using unpaired data. Materials and methods: This study included T2-weighted MR and CT pelvic images of 38 patients in treatment position from five different centers. The AugCGAN was trained on 2D transverse slices of 19 patients from three different sites. The network was then used to generate synthetic CT (sCT) images of 19 patients from the two other sites. Mean absolute errors (MAEs) for each patient were evaluated between real and synthetic CT images. Original treatment plans of nine patients were recalculated using sCT images to assess the dose distribution in terms of voxel-wise dose difference, gamma, and dose-volume histogram analysis. Results: The mean MAEs were 59.8 Hounsfield units (HU) and 65.8 HU for the first and second test sites, respectively. The maximum dose difference to the target was 1.2% with a gamma pass rate using the 3%, 3 mm criteria above 99%. The average time required to generate a complete sCT image for a patient on our GPU was 8.5 s. Conclusion: This study suggests that our unpaired approach achieves good performance in generalization with respect to sCT image generation. (C) 2021 American Association of Physicists in Medicine

Automated summary

MR-to-CT synthesis using an Augmented CycleGAN model showed good performance in generating synthetic CT images from unpaired data, indicating potential for generalization across different scanners and sequences. The mean absolute errors for sCT image generation were 59.8 HU and 65.8 HU for different test sites, with low dose differences and high gamma pass rates observed in dose distribution analysis.