期刊
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE
卷 209, 期 -, 页码 -出版社
ELSEVIER IRELAND LTD
DOI: 10.1016/j.cmpb.2021.106331
关键词
Deep learning; Computer aided diagnosis; Radiographic image; Radiographic image report; Annotation; Object detection; Chest X-ray; Attention; Weakly supervised learning
类别
资金
- JSPS KAKENHI [JP20K07196]
- Council for Science, Technology and Innovation (CSTI)
- cross-ministerial Strategic Innovation Promotion Program (SIP)
- Innovative AI Hospital System
- National Institute of Biomedical Innovation, Health and Nutrition (NIBIOHN)
By utilizing positional information extracted from CXR reports, this study aimed to generate bounding boxes with disease lesions on CXR images. Through semantic segmentation and classification models, object detection on the generated attention bounding boxes improved the precision of nodule detection.
Background and objective: In this study, we tried to create a machine-learning method that detects disease lesions from chest X-ray (CXR) images using a data set annotated with extracted CXR reports information. We set the nodule as the target disease lesion. Manually annotating nodules is costly in terms of time. Therefore, we used the report information to automatically produce training data for the object detection task. Methods: First, we use semantic segmentation model PSP-Net to recognize lung fields described in the CXR reports. Next, a classification model ResNeSt-50 is used to discriminate the nodule in segmented right and left field. It also can provide attention map by Grad-Cam. If the attention region corresponds to the location of the nodule in the CXR reports, an attention bounding box is generated. Finally, object de-tection model Faster-RCNN was performed using generated attention bounding box. The bounding boxes predicted by Faster-RCNN were filtered to satisfy the location extracted from CXR reports. Results: For lung field segmentation, a mean intersection of union of 0.889 was achieved in our best model. 15,156 chest radiographs are used for classification. The area under the receiver operating char-acteristics curve was 0.843 and 0.852 for the left and right lung, respectively. The detection precision of the generated attention bounding box was 0.341 to 0.531 depending on the binary setting for attention map. Through object detection process, the detection precisions of the bounding boxes were improved to 0.567 to 0.800. Conclusion: We successfully generated bounding boxes with nodule on CXR images based on the po-sitional information of the diseases extracted from the CXR reports. Our method has the potential to provide bounding boxes for various lung lesions which can reduce the annotation burden for specialists. Short abstract: Machine learning for computer aided image diagnosis requires annotation of images, but manual annotation is time-consuming for medical doctor. In this study, we tried to create a machine-learning method that creates bounding boxes with disease lesions on chest X-ray (CXR) images using the positional information extracted from CXR reports. We set the nodule as the target lesion. First, we use PSP-Net to segment the lung field according to the CXR reports. Next, a classification model ResNeSt-50 was used to discriminate the nodule in segmented lung field. We also created an attention map using the Grad-Cam algorithm. If the area of attention matched the area annotated by the CXR report, the coordinate of the bounding box was considered as a possible nodule area. Finally, we used the attention information obtained from the nodule classification model and let the object detection model trained by all of the generated bounding boxes. Through object detection model, the precision of the bounding boxes to detect nodule is improved. (c) 2021 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license ( http://creativecommons.org/licenses/by-nc-nd/4.0/ )
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据