Physics-informed multi-modal imaging-based material characterization for proton therapy

Chih-Wei Chang; Raanan Marants; Yuan Gao; Matthew Goette; Jessica E. Scholey; Jeffrey D. Bradley; Tian Liu; Jun Zhou; Atchar Sudhyadhom; Xiaofeng Yang

doi:10.1117/12.2653667

7 April 2023 Physics-informed multi-modal imaging-based material characterization for proton therapy

Chih-Wei Chang, Raanan Marants, Yuan Gao, Matthew Goette, Jessica E. Scholey, Jeffrey D. Bradley, Tian Liu, Jun Zhou, Atchar Sudhyadhom, Xiaofeng Yang

Author Affiliations +

Proceedings Volume 12463, Medical Imaging 2023: Physics of Medical Imaging; 124632J (2023) https://doi.org/10.1117/12.2653667
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Conference Poster

Abstract

Approximately 2.5% of the proton range uncertainty comes from computed tomography (CT) number to material characteristic conversion. We aim to conquer this CT-to-material conversion error by proposing a multimodal imaging framework to enable deep learning (DL)-based material mass density inference using dual-energy CT (DECT) and magnetic resonance imaging (MRI). To ensure the robustness of DL models, we integrated physics insights into the framework to regularize DL models and achieve DL using small datasets. Five MRI-compatible phantoms were created from tissue-mimicking materials that served as a ground true reference to validate the proposed framework. The reference mass densities for each phantom were measured by a 150 MeV proton beam. Multimodal images were acquired from T1- and T2-weighted images and DECT images as training and validation data for DL. Residual networks (ResNet) were implemented to evaluate the feasibility of the proposed framework. ResNet-DE-MR denotes that ResNet was trained with MRI and DECT images, while ResNet-DE presents that only DECT images were used to train ResNet. ResNet was also compared to an empirical DECT model. Meanwhile, a retrospective patient case was included in the study to demonstrate the proof of concept for the proposed framework. The phantom validation experiment showed that ResNet-DE-MR achieved mass density errors of -0.4%, 0.3%, 0.4%, 0.7%, and -0.2% for adipose, muscle, liver, skin, and bone. The proposed DL-based multimodal imaging framework was demonstrated to enable accurate material mass density inference using DECT and MR images. The framework can potentially improve the treatment quality for proton therapy by reducing proton range uncertainty.

Citation Download Citation

Chih-Wei Chang, Raanan Marants, Yuan Gao, Matthew Goette, Jessica E. Scholey, Jeffrey D. Bradley, Tian Liu, Jun Zhou, Atchar Sudhyadhom, and Xiaofeng Yang "Physics-informed multi-modal imaging-based material characterization for proton therapy", Proc. SPIE 12463, Medical Imaging 2023: Physics of Medical Imaging, 124632J (7 April 2023); https://doi.org/10.1117/12.2653667

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available