4.7 Article

A crack-segmentation algorithm fusing transformers and convolutional neural networks for complex detection scenarios

Related references

Note: Only part of the references are listed.
Article Construction & Building Technology

Automated joint 3D reconstruction and visual inspection for buildings using computer vision and transfer learning

Tao Wang et al.

Summary: Regular building inspection and maintenance are necessary preventive measures to maintain building functionality, integrity, and aesthetics. This paper presents an automated 2D-3D computer vision approach, using transfer learning, for joint 3D reconstruction and visual inspection of buildings. The proposed methods integrate 3D scene reconstruction with transfer learning for automated identification of building surface defects, demonstrated through an illustrative example.

AUTOMATION IN CONSTRUCTION (2023)

Article Construction & Building Technology

Binocular video-based 3D reconstruction and length quantification of cracks in concrete structures

Lu Deng et al.

Summary: This paper presents an automated 3D reconstruction and length quantification framework for cracks in concrete structures based on binocular videos. A crack semantic 3D reconstruction method combined with binocular visual simultaneous localization and mapping (VSLAM) and a high-performance segmentation network is proposed to achieve accurate crack 3D characterization and global localization. A 3D crack quantification method based on point cloud processing is also developed to accurately identify individual cracks on the global structure and quantify their lengths. Field tests on a concrete bridge demonstrate the high efficiency and practicability of the proposed automated inspection framework, and the accuracy of crack detection and quantification is validated against manual inspection results.

AUTOMATION IN CONSTRUCTION (2023)

Article Computer Science, Theory & Methods

Transformers in Vision: A Survey

Salman Khan et al.

Summary: Transformer models have shown impressive results in computer vision tasks by simulating long dependencies, supporting parallel processing, and handling multi-modal data. They are widely used in visual recognition, generative modeling, multi-modal tasks, video processing, low-level vision, and three-dimensional analysis, showcasing their strengths in scalability and flexibility.

ACM COMPUTING SURVEYS (2022)

Review Construction & Building Technology

Structural crack detection using deep convolutional neural networks

Raza Ali et al.

Summary: This article reviews the application of Convolutional Neural Networks (CNN) in civil structure crack detection, emphasizing the importance of CNN in image classification and segmentation, as well as analyzing recent developments. In addition to discussing machine learning methods, it also introduces the limitations of manual processing and image processing techniques in crack detection.

AUTOMATION IN CONSTRUCTION (2022)

Article Engineering, Electrical & Electronic

BiAttnNet: Bilateral Attention for Improving Real-Time Semantic Segmentation

Genling Li et al.

Summary: This paper introduces a new two-branch network BiAttnNet that balances speed and accuracy by combining detail branch and context branch. Evaluations on the Cityscapes testing set show that BiAttnNet achieves high semantic segmentation accuracy at high speed.

IEEE SIGNAL PROCESSING LETTERS (2022)

Article Engineering, Multidisciplinary

3D pavement data decomposition and texture level evaluation based on step extraction and Pavement-Transformer

Hongjia Chen et al.

Summary: Pavement texture evaluation is crucial for enhancing skid resistance and pavement maintenance. Existing methods mainly focus on damaged areas and static measurement environment, resulting in a gap between theory and practice. In this study, an efficient texture decomposition method and the Pavement Transformer were proposed to overcome these limitations and improve the accuracy and stability of texture evaluation.

MEASUREMENT (2022)

Article Computer Science, Artificial Intelligence

FAT-Net: Feature adaptive transformers for automated skin lesion segmentation

Huisi Wu et al.

Summary: The study introduces a novel skin lesion segmentation method named FAT-Net, which integrates transformer branch and feature adaptation module to capture long-range dependencies and enhance feature fusion. Experimental results demonstrate the superior accuracy and inference speed of FAT-Net on four public datasets compared to state-of-the-art methods.

MEDICAL IMAGE ANALYSIS (2022)

Article Engineering, Multidisciplinary

Efficient attention-based deep encoder and decoder for automatic crack segmentation

Dong H. Kang et al.

Summary: In this paper, a novel semantic transformer representation network (STRNet) is developed for crack segmentation with fast processing speed and high performance. The network is trained and tested in complex scenes, achieving high precision, recall, F1 score, and mIoU. Comparing with other advanced networks, STRNet shows the best performance in evaluation metrics with the fastest processing speed.

STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL (2022)

Article Engineering, Electrical & Electronic

DcsNet: a real-time deep network for crack segmentation

Jie Pang et al.

Summary: In this paper, a novel Deep Crack Segmentation Network (DcsNet) is proposed, which achieves a balance of speed and accuracy through two feature extraction branches. Extensive experiments show that the proposed network achieves a good trade-off between accuracy and inference speed, outperforming state-of-the-art methods.

SIGNAL IMAGE AND VIDEO PROCESSING (2022)

Article Construction & Building Technology

Sewer defect detection from 3D point clouds using a transformer-based deep learning model

Yunxiang Zhou et al.

Summary: This research develops a deep learning method called TransPCNet for 3D point cloud defect classification. TransPCNet achieves more accurate and effective results by enhancing feature extraction and learning capability, and introducing a novel loss function to address data imbalance issues.

AUTOMATION IN CONSTRUCTION (2022)

Article Engineering, Biomedical

Self-attentional microvessel segmentation via squeeze-excitation transformer Unet

Xiongri Shen et al.

Summary: This study proposes a Squeeze-Excitation Transformer U-net (SETUnet) method to improve the accuracy of vessel segmentation. By introducing the self-attention mechanism, this method performs well in terms of connectivity and surpasses several advanced vessel segmentation neural networks.

COMPUTERIZED MEDICAL IMAGING AND GRAPHICS (2022)

Article Computer Science, Artificial Intelligence

Fully transformer network for skin lesion analysis

Xinzi He et al.

Summary: Automatic skin lesion analysis for segmentation and classification is crucial but challenging due to diverse data sources and locality. To address this, this paper proposes a Fully Transformer Network (FTN) that utilizes Spatial Pyramid Transformer (SPT) to learn long-range contextual information. Experimental results demonstrate the superiority of FTN over other CNN approaches in terms of efficiency and performance.

MEDICAL IMAGE ANALYSIS (2022)

Article Construction & Building Technology

Crack detection algorithm for concrete structures based on super-resolution reconstruction and segmentation network

Chao Xiang et al.

Summary: This paper proposes an automatic microcrack detection method based on super-resolution reconstruction and semantic segmentation. By using deep learning for super-resolution reconstruction and semantic segmentation, the accuracy of crack detection and feature quantification is significantly improved.

AUTOMATION IN CONSTRUCTION (2022)

Article Construction & Building Technology

Automatic concrete crack segmentation model based on transformer

Wenjun Wang et al.

Summary: In this study, a novel SegCrack model for pixel-level crack segmentation using deep learning methods is proposed. The model utilizes a hierarchically structured Transformer encoder to output multiscale features and incorporates a top-down pathway and lateral connections for progressive feature upsampling and fusion. An online hard example mining strategy is also adopted to improve model performance. Experimental results demonstrate SegCrack achieves high precision, recall, F1 score, and mean intersection over union on the test set.

AUTOMATION IN CONSTRUCTION (2022)

Article Computer Science, Interdisciplinary Applications

Tiny-Crack-Net: A multiscale feature fusion network with attention mechanisms for segmentation of tiny cracks

Honghu Chu et al.

Summary: This study proposes a multiscale feature fusion network named Tiny-Crack-Net (TCN) to address the class imbalance and limited local receptive field issues in crack segmentation. By modifying the residual network, incorporating dual attention modules, and implementing multiscale fusion operations, the network's ability to segment tiny cracks is significantly enhanced. Evaluation on an open-source dataset and field test results validate the effectiveness and robustness of Tiny-Crack-Net.

COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING (2022)

Article Construction & Building Technology

Attention-based generative adversarial network with internal damage segmentation using thermography

Rahmat Ali et al.

Summary: This paper introduces a real-time, high-performance deep-learning network for pixel-level segmentation of internal damages in concrete members using active thermography. By developing an attention-based generative adversarial network (AGAN) to train the proposed internal damage segmentation network (IDSNet), it achieved excellent performance on the test set.

AUTOMATION IN CONSTRUCTION (2022)

Article Engineering, Civil

External Attention Based TransUNet and Label Expansion Strategy for Crack Detection

Jie Fang et al.

Summary: This paper proposes an external attention based TransUNet for crack detection, which improves the performance and robustness of the framework through skip connections to propagate texture information and model long-range dependency.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Construction & Building Technology

Intelligent crack detection based on attention mechanism in convolution neural network

Xiaoning Cui et al.

Summary: In this study, the proposed Att-Unet model achieved better results in crack segmentation tasks, showing improved accuracy, precision, and F1-scores. Att-Unet effectively extracts multi-scale features of cracks, focuses on critical areas, and reconstructs semantics to improve crack segmentation capability.

ADVANCES IN STRUCTURAL ENGINEERING (2021)

Article Construction & Building Technology

Structural Crack Detection from Benchmark Data Sets Using Pruned Fully Convolutional Networks

X. W. Ye et al.

Summary: A benchmark data set called a bridge crack library (BCL) containing 11,000 pixel-wise labeled images was established for crack detection on multiple structural materials, serving as a benchmark data set for training deep neural networks and evaluating their performance.

JOURNAL OF STRUCTURAL ENGINEERING (2021)

Article Construction & Building Technology

Robust pixel-wise concrete crack segmentation and properties retrieval using image patches

Yiqing Liu et al.

Summary: This paper proposes a robust crack segmentation approach using image patches, which combines an active contour model, convolutional neural network, and morphological operations to accurately detect and segment cracks. Experimental validation shows significant improvement in accuracy and robustness compared to previous work, with lower data labeling requirements.

AUTOMATION IN CONSTRUCTION (2021)

Article Construction & Building Technology

Automatic crack classification and segmentation on masonry surfaces using convolutional neural networks and transfer learning

Dimitris Dais et al.

Summary: This study explores deep learning techniques for crack detection on masonry walls, achieving an accuracy of 95.3%. Leveraging transfer learning, crack segmentation on masonry surfaces at the pixel level was successfully implemented. This represents the first application of deep learning for pixel-level crack segmentation on masonry surfaces.

AUTOMATION IN CONSTRUCTION (2021)

Article Computer Science, Artificial Intelligence

TrSeg: Transformer for semantic segmentation

Youngsaeng Jin et al.

Summary: This paper introduces a novel semantic segmentation network TrSeg based on transformer architecture, which can adaptively capture multi-scale information, outperforming other methods.

PATTERN RECOGNITION LETTERS (2021)

Article Construction & Building Technology

Semi-supervised semantic segmentation network for surface crack detection

Wenjun Wang et al.

Summary: This paper proposes a semi-supervised semantic segmentation network for crack detection, which reduces the requirement of annotated data and improves the model accuracy through the collaboration of student and teacher models. It can reduce the annotation workload while maintaining high accuracy.

AUTOMATION IN CONSTRUCTION (2021)

Article Automation & Control Systems

Automatic pixel-level crack segmentation in images using fully convolutional neural network based on residual blocks and pixel local weights

Raza Ali et al.

Summary: Deep learning has been applied to automated crack detection and identification processes. In the case of data imbalance, introducing a local weighting factor and sensitivity map can improve the accuracy of crack pixel segmentation. Based on the newly established MSCI dataset, the proposed method shows excellent performance in crack pixel and non-crack pixel accuracy.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2021)

Article Automation & Control Systems

HDCB-Net: A Neural Network With the Hybrid Dilated Convolution for Pixel-Level Crack Detection on Concrete Bridges

Wenbo Jiang et al.

Summary: The study proposed HDCB-Net for pixel-level detection of blurred cracks, achieving efficient fast crack detection through a two-stage strategy with a processing time of only 0.64 seconds per image. Adding to that, a public dataset comprising 150,632 high-resolution images was established for crack detection research purposes.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2021)

Article Engineering, Marine

Bridge Crack Semantic Segmentation Based on Improved Deeplabv3+

Huixuan Fu et al.

Summary: The study proposed a crack detection method based on an improved DeepLabv3+ algorithm utilizing deep learning technology. Experimental results demonstrated that the method achieved higher accuracy in crack segmentation, showing improved ability to accurately identify crack details, thereby proving the effectiveness of the algorithm.

JOURNAL OF MARINE SCIENCE AND ENGINEERING (2021)

Article Construction & Building Technology

Image-based concrete crack detection in tunnels using deep fully convolutional networks

Yupeng Ren et al.

CONSTRUCTION AND BUILDING MATERIALS (2020)

Article Construction & Building Technology

An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement

Ankang Ji et al.

AUTOMATION IN CONSTRUCTION (2020)

Article Construction & Building Technology

Deep learning-based roadway crack classification using laser-scanned range images: A comparative study on hyperparameter selection

Shanglian Zhou et al.

AUTOMATION IN CONSTRUCTION (2020)

Article Construction & Building Technology

Hybrid pixel-level concrete crack segmentation and quantification across complex backgrounds using deep learning

Dongho Kang et al.

AUTOMATION IN CONSTRUCTION (2020)

Article Automation & Control Systems

SDDNet: Real-Time Crack Segmentation

Wooram Choi et al.

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS (2020)

Article Construction & Building Technology

A triple-thresholds pavement crack detection method leveraging random structured forest

Cheng Peng et al.

CONSTRUCTION AND BUILDING MATERIALS (2020)

Article Computer Science, Information Systems

FCN-SFW: Steel Structure Crack Segmentation Using a Fully Convolutional Network and Structured Forests

Sen Wang et al.

IEEE ACCESS (2020)

Article Construction & Building Technology

Automatic sewer pipe defect semantic segmentation based on improved U-Net

Gang Pan et al.

AUTOMATION IN CONSTRUCTION (2020)

Article Computer Science, Information Systems

Automated Pavement Crack Segmentation Using U-Net-Based Convolutional Neural Network

Stephen L. H. Lau et al.

IEEE ACCESS (2020)

Article Engineering, Civil

Automatic Pavement Crack Detection by Multi-Scale Image Fusion

Haifeng Li et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2019)

Article Computer Science, Artificial Intelligence

DeepCrack: A deep hierarchical feature learning architecture for crack segmentation

Yahui Liu et al.

NEUROCOMPUTING (2019)

Article Computer Science, Interdisciplinary Applications

CE-Net: Context Encoder Network for 2D Medical Image Segmentation

Zaiwang Gu et al.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2019)

Article Computer Science, Interdisciplinary Applications

Automatic Pixel-Level Crack Detection and Measurement Using Fully Convolutional Network

Xincong Yang et al.

COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING (2018)

Article Computer Science, Interdisciplinary Applications

Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types

Young-Jin Cha et al.

COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING (2018)

Article Computer Science, Interdisciplinary Applications

Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks

Young-Jin Cha et al.

COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING (2017)

Article Computer Science, Artificial Intelligence

Efficient graph-based image segmentation

PF Felzenszwalb et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2004)