Attention-based Fusion Network for Breast Cancer Segmentation and Classification Using Multi-modal Ultrasound Images
  • Cho, Yoonjae
  • Misra, Sampa
  • Managuli, Ravi
  • Barr, Richard G.
  • Lee, Jeongmin
  • 외 1명
Citations

WEB OF SCIENCE

13
Citations

SCOPUS

19

초록

Objective: Breast cancer is one of the most commonly occurring cancers in women. Thus, early detection and treatment of cancer lead to a better outcome for the patient. Ultrasound (US) imaging plays a crucial role in the early detection of breast cancer, providing a cost-effective, convenient, and safe diagnostic approach. To date, much research has been conducted to facilitate reliable and effective early diagnosis of breast cancer through US image analysis. Recently, with the introduction of machine learning technologies such as deep learning (DL), automated lesion segmentation and classification, the identification of malignant masses in US breasts has progressed, and computer-aided diagnosis (CAD) technology is being applied in clinics effectively. Herein, we propose a novel deep learning-based “segmentation + classification” model based on B- and SE-mode images. Methods: For the segmentation task, we propose a Multi-Modal Fusion U-Net (MMF-U-Net), which segments lesions by mixing B- and SE-mode information through fusion blocks. After segmenting, the lesion area from the B- and SE-mode images is cropped using a predicted segmentation mask. The encoder part of the pre-trained MMF-U-Net model is then used on the cropped B- and SE-mode breast US images to classify benign and malignant lesions. Results: The experimental results using the proposed method showed good segmentation and classification scores. The dice score, intersection over union (IoU), precision, and recall are 78.23%, 68.60%, 82.21%, and 80.58%, respectively, using the proposed MMF-U-Net on real-world clinical data. The classification accuracy is 98.46%. Conclusion: Our results show that the proposed method will effectively segment the breast lesion area and can reliably classify the benign from malignant lesions. © 2024 World Federation for Ultrasound in Medicine & Biology

키워드

Breast cancerBreast ultrasound imagesClassificationMulti-modalitySegmentationTransfer learning
제목
Attention-based Fusion Network for Breast Cancer Segmentation and Classification Using Multi-modal Ultrasound Images
저자
Cho, YoonjaeMisra, SampaManaguli, RaviBarr, Richard G.Lee, JeongminKim, Chulhong
DOI
10.1016/j.ultrasmedbio.2024.11.020
발행일
2025-03
유형
Article
저널명
Ultrasound in Medicine and Biology
51
3
페이지
568 ~ 577