High-resolution and real-time spectral-depth imaging with a compact system

Mingde Yao; Zhiwei Xiong

doi:10.1117/12.2538752

18 November 2019 High-resolution and real-time spectral-depth imaging with a compact system

Mingde Yao, Zhiwei Xiong

Proceedings Volume 11187, Optoelectronic Imaging and Multimedia Technology VI; 1118702 (2019) https://doi.org/10.1117/12.2538752
Event: SPIE/COS Photonics Asia, 2019, Hangzhou, China

Abstract

We develop a compact imaging system to enable simultaneous acquisition of the spectral and depth information in real time. Our system consists of a spectral camera with low spatial resolution and an RGB camera with high spatial resolution, which captures two measurements from two different views of the same scene at the same time. Relying on an elaborate computational reconstruction algorithm with deep learning, our system can eventually obtain a spectral cube with a spatial resolution of 1920×1080 and a total of 16 spectral bands in the visible light section, as well as the corresponding depth map with the same spatial resolution. Evaluations on both benchmark datasets and real-world scenes show that our reconstruction results are accurate and reliable. To the best of our knowledge, this is the first attempt to capture 5D information (3D space + 1D spectrum + 1D time) with a miniaturized apparatus and without active illumination.

Citation Download Citation

Mingde Yao and Zhiwei Xiong "High-resolution and real-time spectral-depth imaging with a compact system", Proc. SPIE 11187, Optoelectronic Imaging and Multimedia Technology VI, 1118702 (18 November 2019); https://doi.org/10.1117/12.2538752

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available