Improving lightweight model for fabric defect segmentation via contrastive knowledge distillation

Chuangjia Ma; Lizhe Qi; Yuzheng Wang; Wensheng Wang; Yunquan Sun

doi:10.1117/12.3004787

9 October 2023 Improving lightweight model for fabric defect segmentation via contrastive knowledge distillation

Chuangjia Ma, Lizhe Qi, Yuzheng Wang, Wensheng Wang, Yunquan Sun

Proceedings Volume 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023); 127911O (2023) https://doi.org/10.1117/12.3004787
Event: Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 2023, Qingdao, SD, China

Abstract

Fabric defect segmentation is an important part of ensuring the quality of product production. Using fabrics with surface defects will affect the quality and reputation of their products. In previous studies, some model compression methods have helped semantic segmentation models to be deployed on resource-limited working devices. However, the capacity reduction of models usually leads to a decline in detection performance. We propose a knowledge distillation method combining traditional KD loss and contrastive relational distillation, which makes student models learn the differential representation among various defects while receiving knowledge transfer from the teacher model. We use DeepLabV3+ and PSPNet with MobileNetV2 backbone networks as student models to validate our method. Experiment shows that our method performs better than direct training and traditional knowledge distillation methods on the DAGM and AITEX datasets. Our method enables lightweight models to achieve higher performance on fabric defect segmentation tasks.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Chuangjia Ma, Lizhe Qi, Yuzheng Wang, Wensheng Wang, and Yunquan Sun "Improving lightweight model for fabric defect segmentation via contrastive knowledge distillation", Proc. SPIE 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 127911O (9 October 2023); https://doi.org/10.1117/12.3004787

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available