Augmentative fusion network for robust RGBT tracking

Fanghua Hong; Jinhu Wang; Andong Lu; Qunjing Wang

doi:10.1117/12.3057761

13 February 2025 Augmentative fusion network for robust RGBT tracking

Fanghua Hong, Jinhu Wang, Andong Lu, Qunjing Wang

Author Affiliations +

Proceedings Volume 13539, Sixteenth International Conference on Graphics and Image Processing (ICGIP 2024); 135392I (2025) https://doi.org/10.1117/12.3057761
Event: Sixteenth International Conference on Graphics and Image Processing (ICGIP 2024), 2024, Nanjing, China

Abstract

RGBT tracking aims to take full advantage of the complementary advantages of RGB and Thermal Infrared (TIR) modalities to achieve robust tracking in complex scenes. However, current approaches face limitations when dealing with the quality-imbalanced problem. In this paper, we introduce a novel augmentative fusion learning framework that aims to maximize the potential of existing fusion modules in modality quality imbalanced scenarios. In particular, we design a modality stochastic degradation strategy to improve the robustness of the fusion module in modality quality imbalance scenarios. Meanwhile, to further enhance the fusion performance with the modality quality imbalance inputs, a self-supervised constraint is introduced to reconstruct the modality features before degradation by combining high- quality modality and degraded modality information. Finally, the effectiveness of the proposed method is verified by evaluating it on two standard RGBT datasets and two state-of-the-art algorithms. And the results indicate that our method achieved superior performance without adding any parameters or computational complexity.

(2025) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Fanghua Hong, Jinhu Wang, Andong Lu, and Qunjing Wang "Augmentative fusion network for robust RGBT tracking", Proc. SPIE 13539, Sixteenth International Conference on Graphics and Image Processing (ICGIP 2024), 135392I (13 February 2025); https://doi.org/10.1117/12.3057761

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE