3D point cloud reconstruction from a single 4D light field image

Helia Farhood; Stuart Perry; Eva Cheng; Juno Kim

doi:10.1117/12.2555292

1 April 2020 3D point cloud reconstruction from a single 4D light field image

Helia Farhood, Stuart Perry, Eva Cheng, Juno Kim

Proceedings Volume 11353, Optics, Photonics and Digital Technologies for Imaging Applications VI; 1135313 (2020) https://doi.org/10.1117/12.2555292
Event: SPIE Photonics Europe, 2020, Online Only

Abstract

Obtaining accurate and noise-free three-dimensional (3D) reconstructions from real world scenes has grown in importance in recent decades. In this paper, we propose a novel strategy for the reconstruction of a 3D point cloud of an object from a single 4D light field (LF) image based on the transformation of point-plane correspondences. Considering a 4D LF image as an input, we first estimate the depth map using point correspondences between sub-aperture images. We then apply histogram equalization and histogram stretching to enhance the separation between depth planes. The main aim of this step is to increase the distance between adjacent depth layers and to enhance the depth map. We then detect edge contours of the original image using fast canny edge detection, and combine linearly the result with that of the previous steps. Following this combination, by transforming the point-plane correspondence, we can obtain the 3D structure of the point cloud. The proposed method avoids feature extraction, segmentation and the extraction of occlusion masks required by other methods, and due to this, our method can reliably mitigate noise. We tested our method with synthetic and real world image databases. To verify the accuracy of our method, we compared our results with two different state-of-the-art algorithms. In this way, we used the LOD (Level of Detail) to compare the number of points needed to describe an object. The results showed that our method had the highest level of detail compared to other existing methods.

Conference Presentation

Citation Download Citation

Helia Farhood, Stuart Perry, Eva Cheng, and Juno Kim "3D point cloud reconstruction from a single 4D light field image", Proc. SPIE 11353, Optics, Photonics and Digital Technologies for Imaging Applications VI, 1135313 (1 April 2020); https://doi.org/10.1117/12.2555292

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available