Journal
COATINGS
Volume 12, Issue 11, Pages -Publisher
MDPI
DOI: 10.3390/coatings12111730
Keywords
no-service rail surface defect; salient object detection; two-stream encoder; transformer; contour information
Categories
Funding
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- Central Guidance on Local Science and Technology Development Fund
- [51805078]
- [N2103011]
- [2022JH6/100100023]
Ask authors/readers for more resources
The detection of no-service rail surface defects is crucial in the rail manufacturing process to prevent financial losses. However, these defects are often difficult to distinguish from the background, posing a challenge for accurate identification. In this study, we introduce salient object detection through machine vision and propose an innovative deep learning network called Two-Stream Swin Transformer Network (TSSTNet) for detecting these defects on rail surfaces.
The detection of no-service rail surface defects is important in the rail manufacturing process. Detection of defects can prevent significant financial losses. However, the texture and form of the defects are often very similar to the background, which makes them difficult for the human eye to distinguish. How to accurately identify rail surface defects thus poses a challenge. We introduce salient object detection through machine vision to deal with this challenge. Salient object detection locates the most significant areas of an image using algorithms, which constitute an integral part of machine vision inspection. However, existing saliency detection networks suffer from inaccurate positioning, poor contouring, and incomplete detection. Therefore, we propose an innovative deep learning network named Two-Stream Swin Transformer Network (TSSTNet) for salient detection of no-service rail surface defects. Specifically, we propose a two-stream encoder-one stream for feature extraction and the other for edge extraction. TSSTNet also includes a three-stream decoder, consisting of a saliency stream, edge stream, and fusion stream. For the problem of incomplete detection, we innovatively introduce the Swin Transformer to model global information. For the problem of unclear contours, we expect to deepen the understanding of the difference in depth between the foreground and background through the learning of contour maps, so the contour alignment module (CAM) is created to deal with this problem. Moreover, to make the most of multimodal information, we suggest a multi-feature fusion module (MFFM). Finally, we conducted comparative experiments with 10 state-of-the-art (SOTA) approaches on the NRSD-MN datasets, and our model performed more competitively than others on five metrics.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available