CVT-Vnet: a convolutional-transformer model for head and neck multi-organ segmentation

Shaoyan Pan; Zhen Tian; Yang Lei; Tonghe Wang; Jun Zhou; Mark McDonald; Jeffrey D. Bradley; Tian Liu; Xiaofeng Yang

doi:10.1117/12.2611540

4 April 2022 CVT-Vnet: a convolutional-transformer model for head and neck multi-organ segmentation

Shaoyan Pan, Zhen Tian, Yang Lei, Tonghe Wang, Jun Zhou, Mark McDonald, Jeffrey D. Bradley, Tian Liu, Xiaofeng Yang

Proceedings Volume 12033, Medical Imaging 2022: Computer-Aided Diagnosis; 120333L (2022) https://doi.org/10.1117/12.2611540
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Abstract

In this work, we propose a convolutional vision transformer V-net (CVT-Vnet) for multi-organ segmentation in 3- dimensional CT images of head and neck cancer patients for radiotherapy treatment planning. Organs include brain-stem, chiasm, mandible, optic nerve (left and right), parotid (left and right), and submandibular (left and right). The proposed CVT-Vnet has a U-shape encoder-decoder architecture. A CVT is firstly deployed as the encoder to encourage global characteristics which still preserve precise local details. And a convolutional decoder is utilized to assemble the segmentation from the features learned by the CVT. We evaluated the network using a dataset of 32 patients undergoing radiotherapy treatment. We present quantitative evaluation of the performance of our proposed CVT-Vnet, in terms of segmentation volume similarity (Dice score, sensitivity , precision and absolution percentage volume difference (AVD)) and surface similarity (Hausdorff distance (HD), mean surface distance (MSD) and residual mean square distance (RMSD)), using the physicians’ manual contour as the ground truth. The volume similarities averaged over all organs were 0.79 as Dice score, 0.83 as sensitivity and 0.78 as precision. The average surface similarities were 13.41mm as HD, 0.39mm as MSD and 1.01mm as RMSD. The proposed network performed significantly better than Vnet and DV-net, which are two state-of-the-art methods. The proposed CVT-Vnet can be a promising tool of multi-organ delineation for head and neck radiotherapy treatment planning.

Conference Presentation

Citation Download Citation

Shaoyan Pan, Zhen Tian, Yang Lei, Tonghe Wang, Jun Zhou, Mark McDonald, Jeffrey D. Bradley, Tian Liu, and Xiaofeng Yang "CVT-Vnet: a convolutional-transformer model for head and neck multi-organ segmentation", Proc. SPIE 12033, Medical Imaging 2022: Computer-Aided Diagnosis, 120333L (4 April 2022); https://doi.org/10.1117/12.2611540

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available