Multi-sensor array for polarimetric light-field imaging

Yunsong Nie; Chongde Zi; Yunqian Li; Tao Yue; Xun Cao

doi:10.1117/12.2306882

24 May 2018 Multi-sensor array for polarimetric light-field imaging

Yunsong Nie, Chongde Zi, Yunqian Li, Tao Yue, Xun Cao

Proceedings Volume 10679, Optics, Photonics, and Digital Technologies for Imaging Applications V; 106791S (2018) https://doi.org/10.1117/12.2306882
Event: SPIE Photonics Europe, 2018, Strasbourg, France

Abstract

Both light-field and polarization information contain lots of clues about scenes, and they can be widely used in variety of computer vision tasks. However, existing imaging systems cannot simultaneously capture the light-field and polarization information. In this paper, we present a low-cost and high-performance miniaturized polarimetric light-field camera, which is based on the six heterogeneous sensors array. The main challenge for the proposed strategy is to align the multi-view images with different polarization characteristics, especially for regions with high degree of polarization -- in which the intensity correlations are commonly weak. To solve this problem, we propose to use Convolutional Neural Network (CNN) based stereo matching method for aligning the heterogeneously polarized images accurately. After stereo matching, both the light field and the Stokes vectors of scene are estimated, and the polarimetry conventions, e.g., the polarization angle, the linear polarization degree and the circular polarization degree, are given. We implement the prototype of the multisensor polarization light-field camera and perform extensive experiments on it. The polarimetric light-field camera achieves six live streaming on time and the heterogeneous processor of NVIDIA Jetson TX2 is exploited for image processing. Benefiting from the multi-sensor parallel polarization imaging and efficient parallel processing, the proposed system achieves promising performance on time resolution, signal-to-noise ratio. Besides, we develop the object recognition applications to show the superiorities of proposed system.

Citation Download Citation

Yunsong Nie, Chongde Zi, Yunqian Li, Tao Yue, and Xun Cao "Multi-sensor array for polarimetric light-field imaging", Proc. SPIE 10679, Optics, Photonics, and Digital Technologies for Imaging Applications V, 106791S (24 May 2018); https://doi.org/10.1117/12.2306882

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available