TPFNet: a tri-band polarimetric image fusion neural network

Yunan Wu; Ning Ma; Jun Chang; Yining Yang; Jinjing Wang

doi:10.1117/12.3015093

30 April 2024 TPFNet: a tri-band polarimetric image fusion neural network

Yunan Wu, Ning Ma, Jun Chang, Yining Yang, Jinjing Wang

Proceedings Volume 13156, Sixth Conference on Frontiers in Optical Imaging and Technology: Imaging Detection and Target Recognition; 131560E (2024) https://doi.org/10.1117/12.3015093
Event: Sixth Conference on Frontiers in Optical Imaging Technology and Applications (FOI2023), 2023, Nanjing, JS, China

Abstract

In current image fusion techniques, image fusion is usually performed on a dual-band image to obtain a fused image with significant target information, or on an intensity image and a polarization image to obtain an image with stronger visual perception. If more information is to be obtained in a single image, tri-band fusion and intensity/polarization image fusion techniques can be combined. In order to solve the above problems, in this paper, we have acquired some tri-band polarization images through a common aperture multispectral polarization photoelectric device, which contains intensity and polarization visible (VIS) images, as well as the intensity images of near-infrared (NIR) and long-wave infrared (LIR). Besides, in order to obtain good image fusion results, we built an end-to-end self-supervised image fusion network and designed an efficient loss function to train the network. We conducted experiments on TPFNet on the acquired dataset and compared it with other image fusion algorithms. The results show that TPFNet achieves excellent results in both subjective and objective evaluations.

Citation Download Citation

Yunan Wu, Ning Ma, Jun Chang, Yining Yang, and Jinjing Wang "TPFNet: a tri-band polarimetric image fusion neural network", Proc. SPIE 13156, Sixth Conference on Frontiers in Optical Imaging and Technology: Imaging Detection and Target Recognition, 131560E (30 April 2024); https://doi.org/10.1117/12.3015093

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available