Automated Registration for Dual-View X-Ray Mammography Using Convolutional Neural Networks

Objective: Automated registration algorithms for a pair of 2D X-ray mammographic images taken from two standard imaging angles, namely, the craniocaudal (CC) and the mediolateral oblique (MLO) views, are developed. Methods: A fully convolutional neural network, a type of convolutional neural network (CNN), is employed to generate a pixel-level deformation field, which provides a mapping between masses in the two views. Novel distance-based regularization is employed, which contributes significantly to the performance. Results: The developed techniques are tested using real 2D mammographic images, slices from real 3D mammographic images, and synthetic mammographic images. Architectural variations of the neural network are investigated and the performance is characterized from various aspects including image resolution, breast density, lesion size, lesion subtlety, and lesion Breast Imaging-Reporting and Data System (BI-RADS) category. Our network outperformed the state-of-the-art CNN-based and non-CNN-based registration techniques, and showed robust performance across various tissue/lesion characteristics. Conclusion: The proposed methods provide a useful automated tool for co-locating lesions between the CC and MLO views even in challenging cases. Significance: Our methods can aid clinicians to establish lesion correspondence quickly and accurately in the dual-view X-ray mammography, improving diagnostic capability.

Automated summary

This paper investigates an automated registration algorithm for 2D X-ray mammographic images using a fully convolutional neural network. The proposed method outperforms state-of-the-art techniques and shows robust performance across various tissue/lesion characteristics.