4.7 Article

Recent progress in transformer-based medical image analysis

Related references

Note: Only part of the references are listed.
Article Chemistry, Multidisciplinary

Polarformer: Optic Disc and Cup Segmentation Using a Hybrid CNN-Transformer and Polar Transformation

Yaowei Feng et al.

Summary: This paper proposes a new method called Polarformer for the precise segmentation of optic disc and optic cup. It extracts discriminative and semantic features using a hybrid CNN-transformer network, and achieves superior performance compared to state-of-the-art methods.

APPLIED SCIENCES-BASEL (2023)

Article Chemistry, Multidisciplinary

Multi-Granularity Dilated Transformer for Lung Nodule Classification via Local Focus Scheme

Kunlun Wu et al.

Summary: Intelligent lung nodules classification is a meaningful and challenging research topic for early precaution of lung cancers, which aims to diagnose the malignancy of candidate nodules from the pulmonary computed tomography images. Nowadays, deep learning methods have made significant achievements in the medical field and promoted developments of lung nodules classification. To tackle the difficulties of mainstream CNNs-based networks in modeling long-range context interaction and spatial dependencies, we propose an effective Multi-Granularity Dilated Transformer to learn the long-range context relations, and explore fine-grained local details via the proposed Local Focus Scheme.

APPLIED SCIENCES-BASEL (2023)

Article Computer Science, Information Systems

Vision Transformer and Language Model Based Radiology Report Generation

Mashood Mohammad Mohsan et al.

Summary: Recent advancements in transformers have been applied to computer vision problems, resulting in state-of-the-art models. Transformer-based models have shown remarkable performance in various sequence prediction tasks such as language translation, sentiment classification, and caption generation. The use of transformers as encoder and decoder in caption or report writing tasks is still unexplored.

IEEE ACCESS (2023)

Article Multidisciplinary Sciences

MedMNIST v2-A large-scale lightweight benchmark for 2D and 3D biomedical image classification

Jiancheng Yang et al.

Summary: We introduce MedMNIST v2, a large-scale dataset collection of standardized biomedical images with 12 datasets for 2D and 6 datasets for 3D. The dataset covers primary data modalities in biomedical images and is designed for lightweight classification tasks. It consists of 708,069 2D images and 9,998 3D images and can support various research purposes in biomedical image analysis, computer vision, and machine learning. We benchmarked baseline methods on MedMNIST v2, including neural networks and AutoML tools.

SCIENTIFIC DATA (2023)

Article Medicine, General & Internal

Vision-Transformer-Based Transfer Learning for Mammogram Classification

Gelan Ayana et al.

Summary: Breast mass identification is crucial for early breast cancer diagnosis. Convolutional neural networks have limitations in determining the nature of breast lumps. Recently, vision transformers have been developed as a transfer learning technique with promising performance in medical image classification, which can be applied to enhance the early diagnosis of breast cancer in a clinical setting.

DIAGNOSTICS (2023)

Article Engineering, Biomedical

PCT: Pyramid convolutional transformer for parotid gland tumor segmentation in ultrasound images

Gang Zhang et al.

Summary: We propose a method for segmenting parotid gland tumors based on a shrinking pyramid framework and a fusion attention transformer CNN. Experimental results demonstrate its superior performance on multiple challenging evaluation benchmarks.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2023)

Article Engineering, Biomedical

Deep learning detection network for peripheral blood leukocytes based on improved detection transformer

Bing Leng et al.

Summary: Leukocytes are vital for healthy immune function and can help fight diseases. Manual examination of leukocytes is currently the best diagnostic method but is time-consuming and requires expertise. Therefore, research on computer-aided diagnostic methods is important.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2023)

Article Computer Science, Interdisciplinary Applications

MMViT-Seg: A lightweight transformer and CNN fusion network for COVID-19 segmentation

Yuan Yang et al.

Summary: This study proposes a lightweight transformer+CNN model, which combines CNN and MobileViT to extract image features and utilizes a multi query attention module to fuse multi-scale features. The results demonstrate that this model performs better than other models on COVID-19 segmentation datasets.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2023)

Article Computer Science, Artificial Intelligence

CSwin-PNet: A CNN-Swin Transformer combined pyramid network for breast lesion segmentation in ultrasound images

Haonan Yang et al.

Summary: In this paper, a pyramid structure network combining a convolutional neural network and Swin Transformer is proposed for automatic segmentation of breast tumors. The network improves the performance of breast lesion segmentation by using interactive channel attention and supplementary feature fusion modules, and introduces a boundary detection module to enhance the boundary quality of segmentation results. Experimental results demonstrate the superiority of the network in breast ultrasound lesion segmentation.

EXPERT SYSTEMS WITH APPLICATIONS (2023)

Article Computer Science, Artificial Intelligence

Brain tumor segmentation based on the fusion of deep semantics and edge information in multimodal MRI

Zhiqin Zhu et al.

Summary: In this paper, a brain tumor segmentation method based on the fusion of deep semantics and edge information in multimodal MRI is proposed. The method utilizes Swin Transformer for semantic feature extraction, introduces a shifted patch tokenization strategy, and designs an edge spatial attention block and a multi-feature inference block based on graph convolution for feature enhancement and fusion. The experimental results demonstrate that the proposed method outperforms other methods in brain tumor segmentation.

INFORMATION FUSION (2023)

Article Computer Science, Interdisciplinary Applications

A combined deformable model and medical transformer algorithm for medical image segmentation

Zhixian Tang et al.

Summary: This study proposes a deep learning-based image segmentation method that achieves high accuracy in medical image segmentation tasks. By combining deformable models and medical transformer neural networks, the proposed method improves segmentation performance.

MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING (2023)

Article Computer Science, Artificial Intelligence

Self-supervised learning based transformer and convolution hybrid network for one-shot organ segmentation

Bo Wang et al.

Summary: Few-shot medical segmentation aims to segment desired regions from input medical imaging data with minimal annotation. A novel transformer and convolution hybrid network is proposed to build global correlation between the reference and desired segmentation samples. Semantic dependency relationship embedding is introduced to the transformer to establish global correlation. Superpixel-based self-supervised learning is employed to train the proposed network for medical image segmentation.

NEUROCOMPUTING (2023)

Article Computer Science, Artificial Intelligence

An effective CNN and Transformer complementary network for medical image segmentation

Feiniu Yuan et al.

Summary: This paper proposes a CNN and Transformer Complementary Network (CTC-Net) for medical image segmentation. It designs two encoders to produce complementary features in Transformer and CNN domains, and uses cross-domain fusion, feature correlation, and dual attention to enhance the representation ability of features. It also incorporates skip connections to extract spatial details, contextual semantics, and long-range information.

PATTERN RECOGNITION (2023)

Article Engineering, Biomedical

TSE DeepLab: An efficient visual transformer for medical image segmentation

Jingdong Yang et al.

Summary: This paper proposes an improved deep learning model for medical image segmentation. By retaining the original atrous convolution and using Transformer module, the model effectively extracts both local and global features, achieving good segmentation accuracy and generalization performance.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2023)

Article Biology

Transformer-based multilevel region and edge aggregation network for magnetic resonance image segmentation

Shaolong Chen et al.

Summary: To improve the quality of MR image edge segmentation, researchers proposed a novel transformer-based multilevel region and edge aggregation network. They achieved significant progress by applying additional edge labels to train the network and aggregating edge and region information. The proposed method outperformed other 2D segmentation methods and achieved high dice scores on both public and private MR datasets.

COMPUTERS IN BIOLOGY AND MEDICINE (2023)

Article Biology

3D-MedTranCSGAN: 3D Medical Image Transformation using CSGAN

S. Poonkodi et al.

Summary: This paper proposes a CSGAN model called 3D-MedTranCSGAN for 3D medical image transformation. The model utilizes PatchGAN discriminator network to penalize the difference between the synthesized image and the original image, and computes non-adversary loss functions. Experimental results show that the proposed model outperforms other transformation methods in various tasks.

COMPUTERS IN BIOLOGY AND MEDICINE (2023)

Article Mathematical & Computational Biology

ConvWin-UNet: UNet-like hierarchical vision Transformer combined with convolution for medical image segmentation

Xiaomeng Feng et al.

Summary: This paper introduces the ConvWin Transformer structure, which combines the self-attention mechanism and convolution and plays a significant role in medical image tasks. By integrating with UNet and improving the upsampling operation, the ConvWin-UNet structure is formed. Experimental results demonstrate that this structure achieves excellent results in medical image segmentation.

MATHEMATICAL BIOSCIENCES AND ENGINEERING (2023)

Article Multidisciplinary Sciences

PCAT-UNet: UNet-like network fused convolution and transformer for retinal vessel segmentation

Danny Chen et al.

Summary: The accurate segmentation of retinal vessels images is important for the diagnosis and monitoring of ophthalmic and systemic diseases. This paper proposes a PCAT-UNET method that combines Transformer and convolutional branches to effectively extract retinal micro vessels feature information, improving segmentation performance while enabling end-to-end training and rapid inference.

PLOS ONE (2022)

Article Chemistry, Analytical

Cross Encoder-Decoder Transformer with Global-Local Visual Extractor for Medical Image Captioning

Hojun Lee et al.

Summary: Transformer-based approaches have shown good results in image captioning tasks, but they have limitations in generating text from global features of an entire image. Therefore, this study proposes novel methods using a Global-Local Visual Extractor (GLVE) and a Cross Encoder-Decoder Transformer (CEDT) to generate better image captioning.

SENSORS (2022)

Article Multidisciplinary Sciences

A large dataset of white blood cells containing cell locations and types, along with segmented nuclei and cytoplasm

Zahra Mousavi Kouzehkanan et al.

Summary: Accurate and early detection of anomalies in peripheral white blood cells is crucial for individual well-being evaluation and diagnosis of hematologic diseases. This study introduces a free access dataset called Raabin-WBC, containing a large number of images of normal white blood cells. The dataset provides diversity for machine learning experiments and tasks in health-related fields.

SCIENTIFIC REPORTS (2022)

Article Health Care Sciences & Services

COVID-19 Detection in CT/X-ray Imagery Using Vision Transformers

Mohamad Mahmoud Al Rahhal et al.

Summary: This study proposes a deep learning framework for Coronavirus detection using CT and X-ray images. The framework demonstrates superior performance in terms of accuracy, precision, recall, specificity, and F1 score compared to state-of-the-art methods. It also exhibits good robustness even when trained with limited data.

JOURNAL OF PERSONALIZED MEDICINE (2022)

Article Biology

Multilevel threshold image segmentation for COVID-19 chest radiography: A framework using horizontal and vertical multiverse optimization

Hang Su et al.

Summary: COVID-19 is spreading globally, and the diagnosis is usually based on examining chest radiographs. Manual processing of the images is not efficient and accurate enough. To improve the efficiency, this research proposes a multilevel thresholding image segmentation method based on an enhanced multiverse optimizer. The method achieves better segmentation results and can help medical organizations process COVID-19 chest radiography effectively.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Engineering, Electrical & Electronic

METrans: Multi-encoder transformer for ischemic stroke segmentation

Jing Wang et al.

Summary: This study proposes a novel multi-encoder transformer network for the segmentation of ischemic stroke lesions, achieving consistent improvements over existing methods on multiple datasets.

ELECTRONICS LETTERS (2022)

Article Chemistry, Analytical

Multiresolution Aggregation Transformer UNet Based on Multiscale Input and Coordinate Attention for Medical Image Segmentation

Shaolong Chen et al.

Summary: This paper proposes a novel medical image segmentation method based on multiscale input and coordinate attention. It achieves improved segmentation accuracy through multiresolution aggregation and feature selection, and outperforms state-of-the-art methods on two challenge datasets.

SENSORS (2022)

Article Chemistry, Multidisciplinary

Swin Transformer Assisted Prior Attention Network for Medical Image Segmentation

Zhihao Liao et al.

Summary: In this paper, a Swin Transformer-based intermediate supervision network called Swin-PANet is proposed for improved accuracy and automation in medical image segmentation tasks. The method utilizes a window-based self-attention mechanism and an enhanced attention block to refine boundaries and enhance interpretability. Experimental results demonstrate that Swin-PANet outperforms state-of-the-art methods in tasks such as cell and skin lesion segmentation.

APPLIED SCIENCES-BASEL (2022)

Article Radiology, Nuclear Medicine & Medical Imaging

TransConver: transformer and convolution parallel network for developing automatic brain tumor segmentation in MRI images

Junjie Liang et al.

Summary: This study proposes a convolution and transformer-based segmentation network called TransConver for brain tumor segmentation. By introducing the TC-Inception module and SCCAF mechanism, the method is able to extract global information while preserving details and achieve better feature fusion. The experimental results demonstrate that the proposed method performs well in brain tumor segmentation tasks.

QUANTITATIVE IMAGING IN MEDICINE AND SURGERY (2022)

Article Computer Science, Artificial Intelligence

Symmetric transformer-based network for unsupervised image registration

Mingrui Ma et al.

Summary: Medical image registration is a crucial task in medical image analysis. This research proposes a convolution-based efficient multihead self-attention (CEMSA) block to address the limitations of the traditional transformer in nonlocal registration. The proposed method achieves state-of-the-art performance in image registration tasks.

KNOWLEDGE-BASED SYSTEMS (2022)

Article Mathematical & Computational Biology

Multisemantic Level Patch Merger Vision Transformer for Diagnosis of Pneumonia

Zheng Jiang et al.

Summary: In this study, a new method called MP-ViT is proposed for automatic diagnosis of pneumonia in chest X-ray images. The method utilizes computer-aided diagnosis technology to reduce the computational cost and make use of intermediate information from the high-level semantic space, resulting in improved diagnostic accuracy.

COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE (2022)

Article Biology

Colorectal polyp region extraction using saliency detection network with neutrosophic enhancement

Keli Hu et al.

Summary: In this paper, a novel method called NeutSS-PLP is proposed for polyp region extraction in colonoscopy images using a short connected saliency detection network with neutrosophic enhancement. Experimental results on two public datasets demonstrate the effectiveness of the proposed method for polyp extraction.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Computer Science, Information Systems

Intelligent Assistant Diagnosis System of Osteosarcoma MRI Image Based on Transformer and Convolution in Developing Countries

Ziqiang Ling et al.

Summary: An intelligent assisted diagnosis system for osteosarcoma was proposed in this study, utilizing methods like classification-image enhancement module and DUconViT to reduce the burden on doctors in diagnosing osteosarcoma and improve image segmentation performance.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2022)

Article Mathematical & Computational Biology

Auxiliary Segmentation Method of Osteosarcoma MRI Image Based on Transformer and U-Net

Feng Liu et al.

Summary: The article introduces a method (OSTransnet) for osteosarcoma MRI image segmentation based on Transformer and U-Net. The method optimizes the dataset and adds an edge enhancement module to improve the accuracy and stability of tumor edge segmentation, demonstrating its potential as an adjunct to clinical diagnosis and treatment.

COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE (2022)

Article Mathematics

BreaST-Net: Multi-Class Classification of Breast Cancer from Histopathological Images Using Ensemble of Swin Transformers

Sudhakar Tummala et al.

Summary: Breast cancer is a deadly form of cancer that is challenging to differentiate using standard imaging procedures. This study demonstrates that an ensemble of Swin transformers performs exceptionally well in classifying breast cancer subtypes from histopathology images, potentially relieving pathologists' workload.

MATHEMATICS (2022)

Article Chemistry, Analytical

An Effective Skin Cancer Classification Mechanism via Medical Vision Transformer

Suliman Aladhadh et al.

Summary: Skin cancer is a deadly disease, and early detection is crucial for survival. Machine learning methods play a significant role in the classification and detection of skin cancer, but face challenges. By using data augmentation and MVT classification model, skin cancer can be classified more accurately.

SENSORS (2022)

Article Chemistry, Analytical

Explainable Transformer-Based Deep Learning Model for the Detection of Malaria Parasites from Blood Cell Images

Md. Robiul Islam et al.

Summary: This article proposes a multiheaded attention-based transformer model for diagnosing malaria parasite from blood cell images. The effectiveness of the model is demonstrated using the Grad-CAM technique to identify the parts of the image that the model pays more attention to. The proposed model achieves high accuracy, precision, recall, F1-score, and AUC score for both the original and modified datasets, outperforming existing methods.

SENSORS (2022)

Article Multidisciplinary Sciences

The Medical Segmentation Decathlon

Michela Antonelli et al.

Summary: This article presents the results of a biomedical image segmentation challenge and suggests that a method capable of performing well on multiple tasks will also generalize well to previously unseen tasks. By organizing the Medical Segmentation Decathlon (MSD), the study confirms that state-of-the-art image segmentation algorithms can generalize well when retrained on unseen tasks, and that consistent performance across multiple tasks is a strong indicator of algorithmic generalizability.

NATURE COMMUNICATIONS (2022)

Article Computer Science, Information Systems

Self-Supervised Bi-Channel Transformer Networks for Computer-Aided Diagnosis

Ronglin Gong et al.

Summary: The paper proposes a task-driven self-supervised learning method (SSBTN) to improve the diagnostic accuracy of a CAD model by enhancing the flexibility of self-supervised learning. SSBTN integrates two different networks into a unified framework and develops a transformer-based transfer module to enhance knowledge transfer efficiency.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2022)

Article Mathematical & Computational Biology

Object Detection in Medical Images Based on Hierarchical Transformer and Mask Mechanism

Yuntao Shou et al.

Summary: The object detection task is challenging in the medical field. This paper proposes a new algorithmic model, MS Transformer, which uses self-supervised learning and hierarchical Transformer model to address the issues of low resolution, high noise, and small object size in medical images. The experimental results show that the proposed model achieves better performance improvement on multiple evaluation metrics.

COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE (2022)

Article Computer Science, Information Systems

CSU-Net: A CNN-Transformer Parallel Network for Multimodal Brain Tumour Segmentation

Yu Chen et al.

Summary: Medical image segmentation techniques play a crucial role in medical image processing and analysis. This study proposes a novel segmentation network called CSU-Net, which merges CNN and Transformer for feature extraction and utilizes dual Swin Transformer decoder blocks for feature upsampling, achieving accurate segmentation of brain tumor images.

ELECTRONICS (2022)

Article Neurosciences

SwinBTS: A Method for 3D Multimodal Brain Tumor Segmentation Using Swin Transformer

Yun Jiang et al.

Summary: Brain tumor semantic segmentation is a critical task in medical image processing. This research proposes SwinBTS, a new approach that combines transformer, convolutional neural network, and encoder-decoder structure for 3D brain tumor segmentation. Experimental results demonstrate that SwinBTS outperforms state-of-the-art 3D algorithms for brain tumor segmentation on 3D MRI scanned images.

BRAIN SCIENCES (2022)

Article Medicine, General & Internal

Transformers Improve Breast Cancer Diagnosis from Unregistered Multi-View Mammograms

Xuxin Chen et al.

Summary: This study proposes a method for breast cancer diagnosis using multi-view vision transformers to capture long-range dependencies between multiple mammograms. The results show that the proposed method outperforms traditional CNNs and one-view two-side models in case classification performance.

DIAGNOSTICS (2022)

Article Biotechnology & Applied Microbiology

Automated Lung-Related Pneumonia and COVID-19 Detection Based on Novel Feature Extraction Framework and Vision Transformer Approaches Using Chest X-ray Images

Chiagoziem C. Ukwuoma et al.

Summary: The research focuses on constructing a reliable deep-learning model for high accuracy classification of lung diseases in chest X-ray images. The proposed framework utilizes ensemble technique, global second-order pooling, and vision transformer approach to extract features and analyze patches individually. The experimental findings show that the presented models outperform traditional deep learning models and other state-of-the-art approaches.

BIOENGINEERING-BASEL (2022)

Article Engineering, Biomedical

RANT: A cascade reverse attention segmentation framework with hybrid transformer for laryngeal endoscope images

Xiaoying Pan et al.

Summary: This study proposes a method for larynx segmentation in medical images, called RANT. The RANT combines Transformer and CNN to successfully extract low-level and global dependency features, and gradually mines the target through reverse attention and receptive field modules. Experimental results on two datasets show that the RANT achieves the best balance in multi-organ segmentation compared to other state-of-the-art networks, with significantly improved mIoU and mDSC scores.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2022)

Article Computer Science, Interdisciplinary Applications

Efficient Combination of CNN and Transformer for Dual-Teacher Uncertainty-guided Semi-supervised Medical Image Segmentation

Zhiyong Xiao et al.

Summary: This study enhances the segmentation of MR images using a semi-supervised learning method with a dual-teacher structure, utilizing a small amount of labeled data and a large amount of unlabeled data. The method significantly improves the segmentation results of MR images with high accuracy.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2022)

Article Biology

Transformer-based factorized encoder for classification of pneumoconiosis on 3D CT images

Yingying Huang et al.

Summary: In the past decade, deep learning methods have been successfully applied in the medical image fields, particularly in the evaluation of lung images for diagnosing pneumoconiosis. A transformer-based factorized encoder (TBFE) was proposed and applied for the classification of pneumoconiosis on 3D CT images. Experimental results showed the superiority of TBFE over other 3D-CNN networks in terms of accuracy, recall, precision, and F1-score.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Biology

Transformer based tooth classification from cone-beam computed tomography for dental charting

Gao Shen et al.

Summary: In this paper, a deep neural network using a combination of CNN and Transformer structures is proposed for tooth classification. The method achieves improved accuracy in both clinical and publicly available datasets.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Biology

Directional mutation and crossover boosted ant colony optimization with application to COVID-19 X-ray image segmentation

Ailiang Qi et al.

Summary: This paper focuses on the study of COVID-19 X-ray image segmentation technology. A new multilevel image segmentation method based on the swarm intelligence algorithm is proposed, along with a designed image segmentation model. Experimental results show that the proposed model achieves more stable and superior segmentation results at different threshold levels.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Biology

TransCUNet: UNet cross fused transformer for medical image segmentation

Shen Jiang et al.

Summary: Accurate segmentation of medical images is crucial, but the complexity of shape and difference in structures of different objects, as well as the small scale of medical datasets, make it difficult to train effectively. To improve the segmentation performance, we propose TransCUNet, a multi-branch network model that effectively extracts high-level and low-level features of medical images of different modalities using cross residual fusion block, pyramidal pooling module, and gated axial-attention. Experimental results show that TransCUNet outperforms current mainstream segmentation methods and has great potential for clinical applications.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Biology

Uncertainty teacher with dense focal loss for semi-supervised medical image segmentation

Jialei Chen et al.

Summary: This paper proposes a method called uncertainty teacher with dense focal loss based on Deep Co-Training for medical image segmentation. The method effectively utilizes unlabeled data, addresses the class imbalance problem, and shows significant improvements in experimental results.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Computer Science, Interdisciplinary Applications

Automated Radiographic Report Generation Purely on Transformer: A Multicriteria Supervised Approach

Zhanyu Wang et al.

Summary: This paper proposes a pure transformer-based framework for automated radiographic report generation in the medical field. It addresses the challenges of visual similarity among medical images and the importance of disease-related words. By improving visual-textual alignment, multi-label classification, and word importance weighting, the framework achieves promising performance in generating accurate reports.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2022)

Article Computer Science, Interdisciplinary Applications

SFOD-Trans: semi-supervised fine-grained object detection framework with transformer module

Quankai Liu et al.

Summary: In this paper, a semi-supervised fine-grained object detection framework with a Transformer module is proposed for hepatic portal vein detection. The experimental results demonstrate that the proposed method achieves satisfactory detection performance with limited labeled data.

MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING (2022)

Article Computer Science, Artificial Intelligence

TransMorph: Transformer for unsupervised medical image registration

Junyu Chen et al.

Summary: Convolutional neural networks (ConvNets) have been a major focus in medical image analysis, but their performance is limited by a lack of consideration for long-range spatial relationships in images. Vision Transformer architectures have recently been proposed to address this issue and have shown state-of-the-art performances in medical imaging applications. In this paper, the researchers propose a hybrid Transformer-ConvNet model called TransMorph for volumetric medical image registration. The proposed model improves the performance significantly compared to existing registration methods and Transformer architectures, demonstrating the effectiveness of Transformers for medical image registration.

MEDICAL IMAGE ANALYSIS (2022)

Article Multidisciplinary Sciences

Transformer and group parallel axial attention co-encoder for medical image segmentation

Chaoqun Li et al.

Summary: In this paper, we propose GPA-TUNet, a medical image segmentation method that synthetically considers local and global information. By introducing a new attention mechanism called GPA and effectively combining it with Transformer in the encoder, this method can highlight the foreground information of samples and reduce the negative impact of background information on segmentation results. Furthermore, the introduction of the sMLP block improves the global modeling capability of the network. Extensive experiments on public datasets confirm the excellent performance of GPA-TUNet.

SCIENTIFIC REPORTS (2022)

Article Neurosciences

A medical image segmentation method based on multi-dimensional statistical features

Yang Xu et al.

Summary: In the field of medical image segmentation, traditional solutions mainly adopt convolutional neural networks (CNNs). This paper proposes a hybrid feature extraction network that combines CNNs and Transformer to better utilize global information for feature extraction and improve the segmentation performance of medical images. Additionally, a multi-dimensional statistical feature extraction module is also introduced to enhance low-dimensional texture features and further improve the segmentation results.

FRONTIERS IN NEUROSCIENCE (2022)

Article Radiology, Nuclear Medicine & Medical Imaging

Dilated transformer: residual axial attention for breast ultrasound image segmentation

Xiaoyan Shen et al.

Summary: This study proposes a dilated transformer method for the segmentation of breast ultrasound images. The method shows comparable performance with the state-of-the-art CNN-based method and outperforms the related transformer-based method on some metrics. The proposed method achieves advanced segmentation performance on limited datasets without pretraining.

QUANTITATIVE IMAGING IN MEDICINE AND SURGERY (2022)

Article Neurosciences

RMTF-Net: Residual Mix Transformer Fusion Net for 2D Brain Tumor Segmentation

Di Gai et al.

Summary: This paper proposes a residual mix transformer fusion net for brain tumor segmentation. By using an overlapping patch embedding mechanism, a parallel fusion strategy, and a global feature integration module, the proposed network improves the segmentation performance.

BRAIN SCIENCES (2022)

Article Biology

TDD-UNet:Transformer with double decoder UNet for COVID-19 lesions segmentation

Xuping Huang et al.

Summary: The outbreak of COVID-19 has brought severe health risks globally. In this study, we propose a Transformer-based double decoder UNet model named TDD-UNet for COVID-19 lesion segmentation. The model incorporates multi-head self-attention of the Transformer and a dual decoder structure to extract global context information and improve segmentation results. Quantitative analysis and comparison on multiple datasets demonstrate the effectiveness of our proposed method in segmenting COVID-19 lesions.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Biology

APT-Net: Adaptive encoding and parallel decoding transformer for medical image segmentation

Ning Zhang et al.

Summary: In this paper, a new CNN-transformer hybrid structure is proposed for medical image segmentation networks. The network introduces an adaptive position encoding module and a dual-path parallel decoder to enhance the encoding of position information and utilization of contextual information. Experimental results demonstrate that the network achieves excellent performance on multiple datasets and outperforms existing methods in terms of accuracy and portability.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Cross-modal Clinical Graph Transformer for Ophthalmic Report Generation

Mingjie Li et al.

Summary: Automatic generation of ophthalmic reports using data-driven neural networks has the potential to improve clinical practice. However, existing methods neglect the prior clinical knowledge of ophthalmologists. To address this issue, a Cross-modal clinical Graph Transformer (CGT) is proposed for ophthalmic report generation, which incorporates clinical relation triples into visual features to improve the decoding process. By extracting clinical entities and relations from training reports and limiting the impact of knowledge using a visible matrix, the proposed CGT outperforms previous benchmark methods and achieves state-of-the-art performance.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Affine Medical Image Registration with Coarse-to-Fine Vision Transformer

Tony C. W. Mok et al.

Summary: This paper presents a fast and robust learning-based algorithm, C2FViT, for 3D affine medical image registration. It leverages the convolutional vision transformer and multi-resolution strategy to learn global affine registration. Experimental results demonstrate that the proposed method outperforms existing CNN-based methods in terms of registration accuracy, robustness, and generalizability.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Bootstrapping ViTs: Towards Liberating Vision Transformers from Pre-training

Haofei Zhang et al.

Summary: This paper introduces a method to address the overfitting issue of ViTs on small datasets by incorporating the inductive biases from CNNs and optimizing the agent CNN and ViT through weight sharing. Experimental results demonstrate that the inductive biases help ViTs converge faster and outperform conventional CNNs with fewer parameters.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2022)

Proceedings Paper Computer Science, Artificial Intelligence

A ConvNet for the 2020s

Zhuang Liu et al.

Summary: The development of visual recognition has gone through stages from ConvNets to ViTs and then to hybrid approaches. In this work, the design of a pure ConvNet is reexamined and several key components are discovered, resulting in the construction of the ConvNeXt model series. These models compete with Transformers in terms of accuracy and performance while maintaining the simplicity and efficiency of ConvNets.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2022)

Article Computer Science, Information Systems

Semi-Supervised Skin Lesion Segmentation With Coupling CNN and Transformer Features

Mohammad D. D. Alahmadi et al.

Summary: An automatic skin lesion segmentation algorithm can reduce the workload in skin cancer analysis and enable early cancer prediction. To overcome the issues of annotated dataset burden and overfitting, a semi-supervised training approach with a surrogate task is proposed to learn data-driven features. The effectiveness of the proposed method is demonstrated through experiments.

IEEE ACCESS (2022)

Article Computer Science, Information Systems

TransNorm: Transformer Provides a Strong Spatial Normalization Mechanism for a Deep Segmentation Model

Reza Azad et al.

Summary: In recent years, convolutional neural networks (CNNs), especially U-Net, have been widely used in medical image processing for segmentation tasks. However, these models fail to capture long-range interactions and spatial dependencies, resulting in performance degradation for medical images with variable shapes and structures. Transformers, originally designed for sequence prediction, have emerged as potential alternatives to model global information using self-attention. This paper proposes Trans-Norm, a novel deep segmentation framework that integrates a Transformer module into both the encoder and skip-connections of the standard U-Net. The authors argue that the design of skip-connections is crucial for accurate segmentation and introduce a Spatial Normalization mechanism to adaptively recalibrate the skip connection path. Extensive experiments on medical image segmentation tasks demonstrate the effectiveness of Trans-Norm.

IEEE ACCESS (2022)

Article Mathematical & Computational Biology

Transformer with progressive sampling for medical cellular image segmentation

Shen Jiang et al.

Summary: This paper introduces the use of transformer in medical image segmentation based on convolutional neural networks and proposes a gated position-sensitive axial attention mechanism for small datasets. Iterative sampling is also utilized to update sampling positions and reduce interference from irrelevant regions. Experimental results demonstrate an improvement in segmentation accuracy compared to networks in recent years.

MATHEMATICAL BIOSCIENCES AND ENGINEERING (2022)

Article Computer Science, Artificial Intelligence

SwinPA-Net: Swin Transformer-Based Multiscale Feature Pyramid Aggregation Network for Medical Image Segmentation

Hao Du et al.

Summary: The precise segmentation of medical images is a critical challenge in pathology research and clinical practice. This article introduces a novel method called SwinPA-Net, which combines two designed modules with Swin Transformer to aggregate multiscale context information and addresses issues such as large differences between different types of lesions and similar shapes and colors between lesions and surrounding tissues. The proposed network achieves state-of-the-art performance on multiple tasks.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Proceedings Paper Computer Science, Artificial Intelligence

AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentation

Xiangyi Yan et al.

Summary: Recent advances in incorporating transformer models into medical image segmentation, particularly in conjunction with the U-Net model, have shown promising results. However, existing methods often overlook the axial-axis information provided by 3D volumes. This paper proposes the AFTer-UNet model, which combines the strengths of convolutional layers and transformers, considers both intra-slice and inter-slice cues, and achieves better performance with fewer parameters and reduced GPU memory usage.

2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022) (2022)

Proceedings Paper Computer Science, Artificial Intelligence

UNETR: Transformers for 3D Medical Image Segmentation

Ali Hatamizadeh et al.

Summary: Fully Convolutional Neural Networks (FCNNs) have been successful in medical image segmentation, but their limited ability to learn long-range dependencies is a challenge. Inspired by transformers in NLP, we propose a novel architecture called UNet Transformers (UNETR) to redefine volumetric medical image segmentation as a sequence prediction problem. By combining transformers and U-shaped network design in the encoder and decoder, we effectively capture global information and achieve semantic segmentation output.

2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022) (2022)

Article Engineering, Electrical & Electronic

DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation

Ailiang Lin et al.

Summary: Automatic medical image segmentation has greatly benefited from powerful deep representation learning. This article proposes a novel framework called DS-TransUNet, which incorporates hierarchical swin transformer into the encoder and decoder, enhancing semantic segmentation quality through self-attention computation and dual-scale encoding. The extensive experiments demonstrate the effectiveness of DS-TransUNet and its superiority over state-of-the-art methods in medical image segmentation tasks.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2022)

Article Computer Science, Information Systems

Multiscale Attention U-Net for Skin Lesion Segmentation

Mohammad D. Alahmadi

Summary: This paper proposes a Multi-Scale Attention U-Net (MSAU-Net) for skin lesion segmentation. The method improves the typical U-Net by inserting an attention mechanism at the bottleneck of the network to model the hierarchical representation. Experimental results demonstrate that the proposed pipeline outperforms the existing alternatives.

IEEE ACCESS (2022)

Article Computer Science, Information Systems

Medical Image Segmentation Using Transformer Networks

Davood Karimi et al.

Summary: In this work, a deep neural network architecture based on self-attention is proposed for achieving more accurate medical image segmentation than fully-convolutional networks (FCNs). The model divides a 3D image block into non-overlapping patches and predicts the segmentation map based on self-attention between these patches. Pre-training strategies are also proposed to overcome the scarcity of labeled medical images. Experimental results show that the proposed model outperforms FCNs on two datasets, even with limited labeled training data.

IEEE ACCESS (2022)

Article Chemistry, Multidisciplinary

COVID-19 Chest X-ray Classification and Severity Assessment Using Convolutional and Transformer Neural Networks

Tuan Le Dinh et al.

Summary: This study introduces the classification of different types of chest X-ray images using deep learning methods, and conducts experiments on COVID-19 severity assessment tasks. The results show that chest X-ray and deep learning can be reliable methods to support doctors in COVID-19 identification and severity assessment tasks.

APPLIED SCIENCES-BASEL (2022)

Article Radiology, Nuclear Medicine & Medical Imaging

TransConver: transformer and convolution parallel network for developing automatic brain tumor segmentation in MRI images

Junjie Liang et al.

Summary: This paper proposes a U-shaped segmentation network TransConver based on convolution and transformer for automatic and accurate brain tumor segmentation in MRI images. The TC-Inception module effectively extracts global information while retaining local details, and the experimental results demonstrate the effectiveness of TransConver in improving the accuracy of brain tumor segmentation.

QUANTITATIVE IMAGING IN MEDICINE AND SURGERY (2022)

Article Computer Science, Artificial Intelligence

A global benchmark of algorithms for segmenting the left atrium from late gadolinium-enhanced cardiac magnetic resonance imaging

Zhaohan Xiong et al.

Summary: Automated segmentation of medical images, particularly for atrial fibrillation ablation treatment, is challenging yet crucial. This study utilized a large dataset and machine learning methods to optimize convolutional neural networks for achieving state-of-the-art left atrium segmentation, showing significant improvements over prior methods and setting a benchmark for future research in the field.

MEDICAL IMAGE ANALYSIS (2021)

Article Radiology, Nuclear Medicine & Medical Imaging

Breast tumor segmentation in 3D automatic breast ultrasound using Mask scoring R-CNN

Yang Lei et al.

Summary: A deep learning-based method was developed for automatic segmentation of breast tumors in ABUS images. Retrospective investigation on 70 patients with confirmed breast tumors showed high segmentation accuracy of the proposed method.

MEDICAL PHYSICS (2021)

Article Radiology, Nuclear Medicine & Medical Imaging

Low dose CT image and projection dataset

Taylor R. Moen et al.

Summary: This dataset consists of CT images and projection data from patient exams at routine clinical doses and simulated lower doses. Collected under local ethics committee approval, it includes data from 299 patient CT exams of three types. The library allows for development and validation of new CT reconstruction and denoising algorithms.

MEDICAL PHYSICS (2021)

Article Computer Science, Artificial Intelligence

Detection of tuberculosis from chest X-ray images: Boosting the performance with vision transformer and transfer learning

Linh T. Duong et al.

Summary: This study aims to early detect tuberculosis using medical imaging and artificial intelligence technology, proposing a solution for detecting tuberculosis from chest X-ray images and utilizing various deep neural network techniques, achieving better performance compared to existing methods.

EXPERT SYSTEMS WITH APPLICATIONS (2021)

Article Radiology, Nuclear Medicine & Medical Imaging

The RSNA International COVID-19 Open Radiology Database (RICORD)

Emily B. Tsai et al.

Summary: The COVID-19 pandemic is a global health emergency, and chest X-rays and CT scans play a vital role in detecting and managing infected patients. The RSNA and Society of Thoracic Radiology collaborated to develop the RICORD database, which provides annotated COVID-19 imaging data for research and education.

RADIOLOGY (2021)

Article Computer Science, Interdisciplinary Applications

Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation: The M&Ms Challenge

Victor M. Campello et al.

Summary: The emergence of deep learning has advanced cardiac magnetic resonance segmentation, yet current models lack generalizability. A recent competition emphasized the importance of data augmentation in training deep learning models and provided new data resources for future research.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2021)

Article Biology

Exploring the effect of image enhancement techniques on COVID-19 detection using chest X-ray images

Tawsifur Rahman et al.

Summary: Computer-aided diagnosis for fast and reliable detection of COVID-19 using a large X-ray dataset, various image enhancement techniques, and deep learning models has shown promising results in this study.

COMPUTERS IN BIOLOGY AND MEDICINE (2021)

Article Computer Science, Artificial Intelligence

VERSE : A Vertebrae labelling and segmentation benchmark for multi-detector CT images

Anjany Sekuboyina et al.

Summary: Vertebral labelling and segmentation are essential tasks in medical image processing, and the VERSE challenge evaluated 25 algorithms on two datasets containing 374 CT scans. The key takeaway is that the performance of an algorithm in correctly identifying rare anatomical variations is crucial for labelling and segmenting spine scans.

MEDICAL IMAGE ANALYSIS (2021)

Article Computer Science, Artificial Intelligence

Multi-level semantic adaptation for few-shot segmentation on cardiac image sequences

Saidi Guo et al.

Summary: This paper proposes multi-level semantic adaptation (MSA) for few-shot segmentation on cardiac image sequences, addressing spatial-temporal distribution bias and long-term information bias through domain adaptation and weight adaptation at sequence-level, frame-level, and pixel-level to improve model adaptation and border feature discrimination.

MEDICAL IMAGE ANALYSIS (2021)

Article Engineering, Biomedical

A vision transformer for emphysema classification using CT images

Yanan Wu et al.

Summary: The study proposed a method for classifying subtypes of emphysema using a vision transformer model, achieving high accuracy in the lab's own dataset by extracting key information from CT images and utilizing pre-trained models.

PHYSICS IN MEDICINE AND BIOLOGY (2021)

Article Computer Science, Artificial Intelligence

A CNN based framework for classification of Alzheimer's disease

Yousry AbdulAzeem et al.

Summary: With advances in healthcare, the diagnosis of Alzheimer's disease has become increasingly important. Studies utilizing brain MRI scans and deep learning algorithms have shown promising results, aiding in the early and accurate classification of Alzheimer's disease.

NEURAL COMPUTING & APPLICATIONS (2021)

Article Health Care Sciences & Services

HybridCTrm: Bridging CNN and Transformer for Multimodal Brain Image Segmentation

Qixuan Sun et al.

Summary: This study proposes a hybrid multimodal segmentation method based on Transformer and CNN, showing superior performance over traditional fully CNN methods in most evaluation metrics. The study also analyzes the influence of Transformer depth on performance, visualizes the results, and explores how the hybrid methods improve segmentations.

JOURNAL OF HEALTHCARE ENGINEERING (2021)

Article Computer Science, Artificial Intelligence

CHAOS Challenge- combined (CT-MR) healthy abdominal organ segmentation

A. Emre Kavur et al.

Summary: Abdominal organ segmentation has long been a comprehensive research field, with recent developments in deep learning introducing new state-of-the-art segmentation systems. However, the effects of DL model properties and parameters on performance are still difficult to interpret, and multi-tasking DL models often perform worse compared to organ-specific ones.

MEDICAL IMAGE ANALYSIS (2021)

Article Oncology

A deep learning-based auto-segmentation system for organs-at-risk on whole-body computed tomography images for radiation therapy

Xuming Chen et al.

Summary: This study introduced a deep learning-based automatic segmentation algorithm, WBNet, which accurately and efficiently delineates major organs at risk (OARs) on CT images. WBNet outperformed other AS algorithms in terms of DSC values and delineation time, showing great effectiveness in clinical practice.

RADIOTHERAPY AND ONCOLOGY (2021)

Article Multidisciplinary Sciences

COVID-CT-MD, COVID-19 computed tomography scan dataset applicable in machine learning and deep learning

Parnian Afshar et al.

Summary: COVID-19 has significantly impacted over 200 countries worldwide, leading to the emergence of a new CT scan dataset, COVID-CT-MD, which shows potential in advancing research and developing advanced ML and DNN solutions for COVID-19.

SCIENTIFIC DATA (2021)

Article Engineering, Biomedical

A fully automated deep learning-based network for detecting COVID-19 from a new and large lung CT scan dataset

Mohammad Rahimzadeh et al.

Summary: This paper presents a high-speed and accurate fully-automated method for detecting COVID-19 from chest CT scan images. By introducing a new dataset and algorithm, the system achieves significant improvements in classification accuracy and speed.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2021)

Article Computer Science, Artificial Intelligence

BS-Net: Learning COVID-19 pneumonia severity on a large chest X-ray dataset

Alberto Signoroni et al.

Summary: This study presents an end-to-end deep learning architecture for predicting the degree of lung compromise in COVID-19 patients on Chest X-ray images. The proposed semi-quantitative scoring system shows significant prognostic value and outperforms human annotators. The BS-Net demonstrates high accuracy and self-attentive behavior, showcasing its potential for computer-assisted monitoring in clinical settings.

MEDICAL IMAGE ANALYSIS (2021)

Article Computer Science, Information Systems

Lung Lesion Localization of COVID-19 From Chest CT Image: A Novel Weakly Supervised Learning Method

Ziduo Yang et al.

Summary: A weakly supervised method based on generative adversarial network for COVID-19 lesion localization using only image-level labels was proposed in this study. By incorporating a novel feature match strategy, the method achieved significantly better results compared to other approaches.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2021)

Article Medicine, General & Internal

TransMed: Transformers Advance Multi-Modal Medical Image Classification

Yin Dai et al.

Summary: The article discusses the advantages and limitations of convolutional neural networks (CNN) and transformers in medical image analysis, proposing a method called TransMed that combines CNN and transformer for multi-modal medical image classification. The approach achieved significant performance improvement on two datasets and outperformed existing CNN-based models.

DIAGNOSTICS (2021)

Proceedings Paper Computer Science, Artificial Intelligence

An End-to-End Transformer Model for 3D Object Detection

Ishan Misra et al.

Summary: 3DETR is an end-to-end Transformer based object detection model for 3D point clouds, requiring minimal modifications to the vanilla Transformer block and outperforming specialized architectures on the ScanNetV2 dataset. It is applicable to tasks beyond detection and can serve as a building block for future research.

2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Recurrent Mask Refinement for Few-Shot Medical Image Segmentation

Hao Tang et al.

Summary: This work proposes a new framework for few-shot medical image segmentation based on prototypical networks, achieving substantial improvement over state-of-the-art methods in experiments by designing a context relation encoder and a recurrent mask refinement module.

2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) (2021)

Proceedings Paper Computer Science, Artificial Intelligence

VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers

Sharif Amit Kamran et al.

Summary: This study introduces a conditional GAN with image generation capabilities to synthesize FA images and predict retinal degeneration simultaneously, addressing the issue of imaging retinal vasculature and predicting abnormalities. The semi-supervised approach used for training and validation show its superiority over recent generative networks.

2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021) (2021)

Article Engineering, Electrical & Electronic

A Model-Driven Scheme to Compensate the Strain-Based Non-Intrusive Dynamic Pressure Measurement for Hydraulic Pipe

Zechao Wang et al.

Summary: A dual-stage model-driven scheme is proposed to compensate dynamic pressure measurement by deriving DSSCs from axial governing equations of pipes, considering both thin-walled and thick-walled pipes, and calibrating physical parameters to minimize the residual between experimental and theoretical results. The compensated dynamic pressure based on the relationship between DSSCs and SSSCs shows significantly reduced relative error in an industrial hydraulic pipe system, validating the proposed compensation method.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2021)

Article Radiology, Nuclear Medicine & Medical Imaging

Crowdsourcing pneumothorax annotations using machine learning annotations on the NIH chest X-ray dataset

Ross W. Filice et al.

JOURNAL OF DIGITAL IMAGING (2020)

Article Computer Science, Artificial Intelligence

REFUGE Challenge: A unified framework for evaluating automated methods for glaucoma assessment from fundus photographs

Jose Ignacio Orlando et al.

MEDICAL IMAGE ANALYSIS (2020)

Article Computer Science, Interdisciplinary Applications

A Multi-Organ Nucleus Segmentation Challenge

Neeraj Kumar et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2020)

Article Radiology, Nuclear Medicine & Medical Imaging

COVID-19 outbreak in Italy: experimental chest X-ray scoring system for quantifying and monitoring disease progression

Andrea Borghesi et al.

RADIOLOGIA MEDICA (2020)

Article Multidisciplinary Sciences

Video-based AI for beat-to-beat assessment of cardiac function

David Ouyang et al.

NATURE (2020)

Article Computer Science, Artificial Intelligence

Attention-guided CNN for image denoising

Chunwei Tian et al.

NEURAL NETWORKS (2020)

Article Medicine, General & Internal

Deep Learning Based Automatic Malaria Parasite Detection from Blood Smear and Its Smartphone Based Application

K. M. Faizullah Fuhad et al.

DIAGNOSTICS (2020)

Article Computer Science, Interdisciplinary Applications

Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images

Deng-Ping Fan et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2020)

Article Engineering, Electrical & Electronic

Learning to Segment Brain Anatomy From 2D Ultrasound With Less Data

Jeya Maria Jose Valanarasu et al.

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING (2020)

Article Acoustics

ATTENTION-ENRICHED DEEP LEARNING MODEL FOR BREAST TUMOR SEGMENTATION IN ULTRASOUND IMAGES

Aleksandar Vakanski et al.

ULTRASOUND IN MEDICINE AND BIOLOGY (2020)

Article Computer Science, Artificial Intelligence

PadChest: A large chest x-ray image dataset with multi-label annotated reports

Aurelia Bustos et al.

MEDICAL IMAGE ANALYSIS (2020)

Article Multidisciplinary Sciences

Chest imaging representing a COVID-19 positive rural US population

Shivang Desai et al.

SCIENTIFIC DATA (2020)

Proceedings Paper Computer Science, Artificial Intelligence

Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networks

Tony C. W. Mok et al.

2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2020)

Article Computer Science, Artificial Intelligence

Deep Retinal Image Segmentation With Regularization Under Geometric Priors

Venkateswararao Cherukuri et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

Article Multidisciplinary Sciences

Dataset of breast ultrasound images

Walid Al-Dhabyani et al.

DATA IN BRIEF (2020)

Article Computer Science, Information Systems

Reliable Tuberculosis Detection Using Chest X-Ray With Deep Learning, Segmentation and Visualization

Tawsifur Rahman et al.

IEEE ACCESS (2020)

Article Computer Science, Information Systems

Can AI Help in Screening Viral and COVID-19 Pneumonia?

Muhammad E. H. Chowdhury et al.

IEEE ACCESS (2020)

Article Computer Science, Interdisciplinary Applications

Segmentation of Nuclei in Histopathology Images by Deep Regression of the Distance Map

Peter Naylor et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2019)

Article Computer Science, Artificial Intelligence

Multivariate Mixture Model for Myocardial Segmentation Combining Multi-Source Images

Xiahai Zhuang

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2019)

Article Biochemical Research Methods

Structured crowdsourcing enables convolutional segmentation of histology images

Mohamed Amgad et al.

BIOINFORMATICS (2019)

Article Computer Science, Interdisciplinary Applications

A Recurrent CNN for Automatic Detection and Classification of Coronary Artery Plaque and Stenosis in Coronary CT Angiography

Majd Zreik et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2019)

Article Computer Science, Interdisciplinary Applications

Benchmark on Automatic Six-Month-Old Infant Brain Segmentation Algorithms: The iSeg-2017 Challenge

Li Wang et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2019)

Article Biochemical Research Methods

Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl

Juan C. Caicedo et al.

NATURE METHODS (2019)

Article Computer Science, Interdisciplinary Applications

Domain Progressive 3D Residual Convolution Network to Improve Low-Dose CT Imaging

Xiangrui Yin et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2019)

Article Computer Science, Artificial Intelligence

Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images

Simon Graham et al.

MEDICAL IMAGE ANALYSIS (2019)

Article Engineering, Biomedical

A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation

Max-Heinrich Laves et al.

INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Spatiotemporal CNN for Video Object Segmentation

Kai Xu et al.

2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)

Article Computer Science, Artificial Intelligence

Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose CT image reconstruction

Hongming Shan et al.

NATURE MACHINE INTELLIGENCE (2019)

Article Biochemistry & Molecular Biology

Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning

Daniel S. Kermany et al.

Article Computer Science, Interdisciplinary Applications

Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved?

Olivier Bernard et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2018)

Article Computer Science, Interdisciplinary Applications

Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss

Qingsong Yang et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2018)

Article Radiology, Nuclear Medicine & Medical Imaging

MR and CT data with multiobserver delineations of organs in the pelvic areaPart of the Gold Atlas project

Tufve Nyholm et al.

MEDICAL PHYSICS (2018)

Article Computer Science, Information Systems

Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks

Moi Hoon Yap et al.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2018)

Article Multidisciplinary Sciences

A large, open source dataset of stroke anatomical brain images and manual lesion segmentations

Sook-Lei Liew et al.

SCIENTIFIC DATA (2018)

Article Radiology, Nuclear Medicine & Medical Imaging

DeepLesion: automated mining of large-scale lesion annotations and universal lesion detection with deep learning

Ke Yan et al.

JOURNAL OF MEDICAL IMAGING (2018)

Article Computer Science, Interdisciplinary Applications

Constrained Deep Weak Supervision for Histopathology Image Segmentation

Zhipeng Jia et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2017)

Article Computer Science, Interdisciplinary Applications

Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network

Hu Chen et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2017)

Article Computer Science, Interdisciplinary Applications

A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology

Neeraj Kumar et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2017)

Article Medicine, General & Internal

Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer

Babak Ehteshami Bejnordi et al.

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION (2017)

Article Computer Science, Artificial Intelligence

ISLES 2015-A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI

Oskar Maier et al.

MEDICAL IMAGE ANALYSIS (2017)

Article Computer Science, Artificial Intelligence

Gland segmentation in colon histology images: The glas challenge contest

Korsuk Sirinukunwattana et al.

MEDICAL IMAGE ANALYSIS (2017)

Article Radiology, Nuclear Medicine & Medical Imaging

Low-dose CT for the detection and classification of metastatic liver lesions: Results of the 2016 Low Dose CT Grand Challenge

Cynthia H. McCollough et al.

MEDICAL PHYSICS (2017)

Article Health Care Sciences & Services

A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images

David Vazquez et al.

JOURNAL OF HEALTHCARE ENGINEERING (2017)

Proceedings Paper Computer Science, Artificial Intelligence

The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation

Simon Jegou et al.

2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW) (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Densely Connected Convolutional Networks

Gao Huang et al.

30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Mask R-CNN

Kaiming He et al.

2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2017)

Article Computer Science, Information Systems

Preparing a collection of radiology examinations for distribution and retrieval

Dina Demner-Fushman et al.

JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION (2016)

Article Computer Science, Interdisciplinary Applications

Automated Polyp Detection in Colonoscopy Videos Using Shape and Context Information

Nima Tajbakhsh et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2016)

Article Computer Science, Artificial Intelligence

Multi-scale patch and multi-modality atlases for whole heart segmentation of MRI

Xiahai Zhuang et al.

MEDICAL IMAGE ANALYSIS (2016)

Article Multidisciplinary Sciences

Multi-class texture analysis in colorectal cancer histology

Jakob Nikolas Kather et al.

SCIENTIFIC REPORTS (2016)

Article Engineering, Biomedical

WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians

Jorge Bernal et al.

COMPUTERIZED MEDICAL IMAGING AND GRAPHICS (2015)

Article Computer Science, Interdisciplinary Applications

The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)

Bjoern H. Menze et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2015)

Article Mathematical & Computational Biology

MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans

Adrienne M. Mendrik et al.

COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE (2015)

Article Computer Science, Artificial Intelligence

The PASCAL Visual Object Classes Challenge: A Retrospective

Mark Everingham et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2015)

Article Computer Science, Artificial Intelligence

Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge

Geert Litjens et al.

MEDICAL IMAGE ANALYSIS (2014)

Article Multidisciplinary Sciences

Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach

Hugo J. W. L. Aerts et al.

NATURE COMMUNICATIONS (2014)

Article Engineering, Biomedical

Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer

Juan Silva et al.

INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY (2014)

Article Radiology, Nuclear Medicine & Medical Imaging

The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository

Kenneth Clark et al.

JOURNAL OF DIGITAL IMAGING (2013)

Article Radiology, Nuclear Medicine & Medical Imaging

Population of anatomically variable 4D XCAT adult phantoms for imaging research and optimization

W. P. Segars et al.

MEDICAL PHYSICS (2013)

Article Radiology, Nuclear Medicine & Medical Imaging

INbreast: Toward a Full-field Digital Mammographic Database

Ines C. Moreira et al.

ACADEMIC RADIOLOGY (2012)

Article Radiology, Nuclear Medicine & Medical Imaging

Computer-aided detection of breast masses depicted on full-field digital mammograms: a performance assessment

B. Zheng et al.

BRITISH JOURNAL OF RADIOLOGY (2012)

Article Mathematical & Computational Biology

Diabetic Retinopathy Grading by Digital Curvelet Transform

Shirin Hajeb Mohammad Alipour et al.

COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE (2012)

Article Engineering, Biomedical

An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation

Muhammad Moazam Fraz et al.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2012)

Review Neurosciences

The Parkinson Progression Marker Initiative (PPMI)

Kenneth Marek et al.

PROGRESS IN NEUROBIOLOGY (2011)

Article Computer Science, Interdisciplinary Applications

Quantitative Analysis of Pulmonary Emphysema Using Local Binary Patterns

Lauge Sorensen et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2010)

Article Neurosciences

Construction of a 3D probabilistic atlas of human cortical structures

David W. Shattuck et al.

NEUROIMAGE (2008)

Article Computer Science, Interdisciplinary Applications

Ridge-based vessel segmentation in color images of the retina

J Staal et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2004)

Article Computer Science, Interdisciplinary Applications

Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response

A Hoover et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2000)