Pavement defect detection based on multiscale image fusion

Yushi Yan; Jiahui Sun; Yuhao Xiang; Guanwen Yan; Yichen Xiao; Jiadi Chen

doi:10.1117/12.3038461

23 August 2024 Pavement defect detection based on multiscale image fusion

Yushi Yan, Jiahui Sun, Yuhao Xiang, Guanwen Yan, Yichen Xiao, Jiadi Chen

Proceedings Volume 13250, Fourth International Conference on Image Processing and Intelligent Control (IPIC 2024); 132502P (2024) https://doi.org/10.1117/12.3038461
Event: 4th International Conference on Image Processing and Intelligent Control (IPIC 2024), 2024, Kuala Lumpur, Malaysia

Abstract

Existing target detection algorithms perform well in common road scenarios, however, in real complex road environments, where a large number of targets and small targets are prevalent, it is still a challenging task for pavement defect detection methods to achieve the ideal state. For this reason, this paper proposes a pavement defect detection network based on multi-scale image fusion. The network uses multiple detection heads and an almost parameter-free TripletAttention module to reach the interaction between different dimensions. To cope with the high-density target detection problem, we propose a YOLOv7 network structure combined with LSK spatial attention module and introduce a new multi-scale selective fusion module, MSF, to extract image features at different scales. Finally, this paper incorporates the activation function Mish() to enhance the model's ability to recognize overlapping and occluded objects. Experiments conducted on the dataset UDTIRI show that the improved method in this paper improves the overall AP by 4.5% and mIoU by 4.6% relative to YOLOv7 target detection algorithm for baseline networks. The ablation experiments and visualization performance demonstrate the rationality and superiority of this paper's method.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yushi Yan, Jiahui Sun, Yuhao Xiang, Guanwen Yan, Yichen Xiao, and Jiadi Chen "Pavement defect detection based on multiscale image fusion", Proc. SPIE 13250, Fourth International Conference on Image Processing and Intelligent Control (IPIC 2024), 132502P (23 August 2024); https://doi.org/10.1117/12.3038461

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available