Infrared and visible image fusion method based on saliency detection and multi-scale texture detail feature extraction

Chenhua Liu; Lin Zhang; Lei Deng; Chentong Guo; Xitian Lu; Lianqing Zhu; Mingli Dong

doi:10.1117/12.3032379

13 September 2024 Infrared and visible image fusion method based on saliency detection and multi-scale texture detail feature extraction

Chenhua Liu, Lin Zhang, Lei Deng, Chentong Guo, Xitian Lu, Lianqing Zhu, Mingli Dong

Author Affiliations +

Proceedings Volume 13178, Eleventh International Symposium on Precision Mechanical Measurements; 1317802 (2024) https://doi.org/10.1117/12.3032379
Event: Eleventh International Symposium on Precision Mechanical Measurements, 2023, Guangzhou, China

Abstract

A single Visible (VIS) image or Infrared (IR) image cannot clearly present the texture details and heat source information of the scene. The fusion task of IR images and VIS can combine the respective characteristics of the two types of modalities to form a new image with rich details, which can better serve advanced vision tasks. Firstly, Kmeans and connected component analysis are used to obtain the IR saliency map. Then, we use Gaussian pyramid to perform multi-scale decomposition of VIS images. Use Gabor filter to extract texture to generate VIS detail map. Finally we use the adaptive fusion rule to obtain high-quality fused images. By conducting a large number of experiments on TNO and LLVIP, and compared them with existing image fusion methods. The experimental results show that our proposed algorithm has potential performance in both quantitative and qualitative evaluations, and has real-time performance during the fusion process.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Chenhua Liu, Lin Zhang, Lei Deng, Chentong Guo, Xitian Lu, Lianqing Zhu, and Mingli Dong "Infrared and visible image fusion method based on saliency detection and multi-scale texture detail feature extraction", Proc. SPIE 13178, Eleventh International Symposium on Precision Mechanical Measurements, 1317802 (13 September 2024); https://doi.org/10.1117/12.3032379

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available