Deep learning based multiple sclerosis lesion detection utilizing synthetic data generation and soft attention mechanism

Omer Zucker Shmueli; Chen Solomon; Noam Ben-Eliezer; Hayit Greenspan

doi:10.1117/12.2613283

4 April 2022 Deep learning based multiple sclerosis lesion detection utilizing synthetic data generation and soft attention mechanism

Omer Zucker Shmueli, Chen Solomon, Noam Ben-Eliezer, Hayit Greenspan

Author Affiliations +

Proceedings Volume 12033, Medical Imaging 2022: Computer-Aided Diagnosis; 120330R (2022) https://doi.org/10.1117/12.2613283
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Abstract

In this work we focus on identifying healthy brain slices vs brain slices with Multiple sclerosis (MS) lesions. MS is an autoimmune, demyelinating disease characterized by inflammatory lesions in the central nervous system. MRI is commonly used for diagnosis of MS, and enables accurate detection and classification of lesions for early diagnosis and treatment. Visual attention mechanisms may be beneficial for the detection of MS brain lesions, as they tend to be small. The attention mechanism prevents overfitting of the background when the amount of data is limited. In addition, enough data is necessary for training a successful machine learning algorithms for medical image analysis. Data with insufficient variability leads to poor classification performance. This is problematic in medical imaging where abnormal findings are uncommon and data labeling requires expensive expert’s time. In this work, we suggest a new network architecture, based on Y-net and EfficientNet models, with attention layers to improve the network performance and reduce overfitting. Furthermore, the attention layers allow extraction of lesion locations. In addition, we show an innovative regularization scheme on the attention weight mask to make it focus on the lesions while letting it search in different areas. Finally, we explore an option to add synthetic lesions in the training process. Based on recent work, we generate artificial lesions in healthy brain MRI scans to augment our training data. Our system achieves 91% accuracy in identifying cases that contain lesions (vs. healthy cases) with more than 13% improvement over an equivalent system without the attention and the data added.

Conference Presentation

Citation Download Citation

Omer Zucker Shmueli, Chen Solomon, Noam Ben-Eliezer, and Hayit Greenspan "Deep learning based multiple sclerosis lesion detection utilizing synthetic data generation and soft attention mechanism", Proc. SPIE 12033, Medical Imaging 2022: Computer-Aided Diagnosis, 120330R (4 April 2022); https://doi.org/10.1117/12.2613283

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available