Registration and Fusion of Thermographic and Visual-Light Images in Neurosurgery

An intraoperative imaging system facilitating the localisation and characterisation of functional areas, pathological tissue, or perfusion disorders, could enormously support medical decisions during neurosurgical interventions and, thus, reduce the risk for the patients. To provide both structural and functional information of the brain tissue to the surgeon, a novel multimodal approach based on the measurement of long-wave infrared radiation and visual-light imaging is very promising. In this contribution, we discuss various methods for the registration and fusion of thermographic and visual-light images. The methods are evaluated quantitatively and qualitatively regarding their practicability during surgery. Furthermore, we introduce appropriate architectures for a digital hardware implementation of the registration and fusion algorithms. The designs are implemented on our reconfigurable intraoperative imaging system, revealing real-time processing performance.