Domain Aware Multi-task Pretraining of 3D Swin Transformer for T1-Weighted Brain MRI
Citations

WEB OF SCIENCE

1
Citations

SCOPUS

2

초록

The scarcity of annotated medical images is a major bottleneck in developing learning models for medical image analysis. Hence, recent studies have focused on pretrained models with fewer annotation requirements that can be fine-tuned for various downstream tasks. However, existing approaches are mainly 3D adaptions of 2D approaches ill-suited for 3D medical imaging data. Motivated by this gap, we propose novel domain-aware multi-task learning tasks to pretrain a 3D Swin Transformer for brain magnetic resonance imaging (MRI). Our method considers the domain knowledge in brain MRI by incorporating brain anatomy and morphology as well as standard pretext tasks adapted for 3D imaging in a contrastive learning setting. We pretrain our model using large-scale brain MRI data of 13,687 samples spanning several large-scale databases. Our method outperforms existing supervised and self-supervised methods in three downstream tasks of Alzheimer’s disease classification, Parkinson’s disease classification, and age prediction tasks. The ablation study of the proposed pretext tasks shows the effectiveness of our pretext tasks. Our code is available at github.com/jongdory/DAMT. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

키워드

3D Medical Image AnalysisMagnetic Resonance ImagingSelf supervised learningSwin TransformerNEUROIMAGING INITIATIVE ADNIOPEN ACCESS SERIESALZHEIMERS-DISEASEPARKINSONS-DISEASEATROPHYPARCELLATIONPATTERNSATLAS
제목
Domain Aware Multi-task Pretraining of 3D Swin Transformer for T1-Weighted Brain MRI
저자
Kim, JonghunKim, MansuPark, Hyunjin
DOI
10.1007/978-981-96-0901-7_8
발행일
2025
유형
Proceedings Paper
저널명
Lecture Notes in Computer Science
15473 LNCS
페이지
121 ~ 141