Real-time planar segmentation of depth images: from three-dimensional edges to segmented planes

Hani Javan Hemmat; Egor Yahor Bondarev; Peter H. N. de With

doi:10.1117/1.JEI.24.5.051008

22 October 2015 Real-time planar segmentation of depth images: from three-dimensional edges to segmented planes

Hani Javan Hemmat, Egor Yahor Bondarev, Peter H. N. de With

Author Affiliations +

Journal of Electronic Imaging, Vol. 24, Issue 5, 051008 (October 2015). https://doi.org/10.1117/1.JEI.24.5.051008

Abstract

Real-time execution of processing algorithms for handling depth images in a three-dimensional (3-D) data framework is a major challenge. More specifically, considering depth images as point clouds and performing planar segmentation requires heavy computation, because available planar segmentation algorithms are mostly based on surface normals and/or curvatures, and, consequently, do not provide real-time performance. Aiming at the reconstruction of indoor environments, the spaces mainly consist of planar surfaces, so that a possible 3-D application would strongly benefit from a real-time algorithm. We introduce a real-time planar segmentation method for depth images avoiding any surface normal calculation. First, we detect 3-D edges in a depth image and generate line segments between the identified edges. Second, we fuse all the points on each pair of intersecting line segments into a plane candidate. Third and finally, we implement a validation phase to select planes from the candidates. Furthermore, various enhancements are applied to improve the segmentation quality. The GPU implementation of the proposed algorithm segments depth images into planes at the rate of 58 fps. Our pipeline-interleaving technique increases this rate up to 100 fps. With this throughput rate improvement, the application benefit of our algorithm may be further exploited in terms of quality and enhancing the localization.

Citation Download Citation

Hani Javan Hemmat, Egor Yahor Bondarev, and Peter H. N. de With "Real-time planar segmentation of depth images: from three-dimensional edges to segmented planes," Journal of Electronic Imaging 24(5), 051008 (22 October 2015). https://doi.org/10.1117/1.JEI.24.5.051008

Published: 22 October 2015

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available