Demosaicking for full motion video 9-band SWIR sensor

Andrey V. Kanaev; Marjorie Rawhouser; Mary R. Kutteruf; Michael K. Yetzbacher; Michael J. DePrenger; Kyle M. Novak; Corey A. Miller; Christopher W. Miller

doi:10.1117/12.2051223

28 May 2014 Demosaicking for full motion video 9-band SWIR sensor

Andrey V. Kanaev, Marjorie Rawhouser, Mary R. Kutteruf, Michael K. Yetzbacher, Michael J. DePrenger, Kyle M. Novak, Corey A. Miller, Christopher W. Miller

Author Affiliations +

Proceedings Volume 9104, Spectral Imaging Sensor Technologies: Innovation Driving Advanced Application Capabilities; 910407 (2014) https://doi.org/10.1117/12.2051223
Event: SPIE Sensing Technology + Applications, 2014, Baltimore, MD, United States

Abstract

Short wave infrared (SWIR) spectral imaging systems are vital for Intelligence, Surveillance, and Reconnaissance (ISR) applications because of their abilities to autonomously detect targets and classify materials. Typically the spectral imagers are incapable of providing Full Motion Video (FMV) because of their reliance on line scanning. We enable FMV capability for a SWIR multi-spectral camera by creating a repeating pattern of 3x3 spectral filters on a staring focal plane array (FPA). In this paper we present the imagery from an FMV SWIR camera with nine discrete bands and discuss image processing algorithms necessary for its operation. The main task of image processing in this case is demosaicking of the spectral bands i.e. reconstructing full spectral images with original FPA resolution from spatially subsampled and incomplete spectral data acquired with the choice of filter array pattern. To the best of author's knowledge, the demosaicking algorithms for nine or more equally sampled bands have not been reported before. Moreover all existing algorithms developed for demosaicking visible color filter arrays with less than nine colors assume either certain relationship between the visible colors, which are not valid for SWIR imaging, or presence of one color band with higher sampling rate compared to the rest of the bands, which does not conform to our spectral filter pattern. We will discuss and present results for two novel approaches to demosaicking: interpolation using multi-band edge information and application of multi-frame super-resolution to a single frame resolution enhancement of multi-spectral spatially multiplexed images.

Citation Download Citation

Andrey V. Kanaev, Marjorie Rawhouser, Mary R. Kutteruf, Michael K. Yetzbacher, Michael J. DePrenger, Kyle M. Novak, Corey A. Miller, and Christopher W. Miller "Demosaicking for full motion video 9-band SWIR sensor", Proc. SPIE 9104, Spectral Imaging Sensor Technologies: Innovation Driving Advanced Application Capabilities, 910407 (28 May 2014); https://doi.org/10.1117/12.2051223

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available