Real-time depth map manipulation for 3D visualization

Ianir Ideses; Barak Fishbain; Leonid Yaroslavsky

doi:10.1117/12.812405

4 February 2009 Real-time depth map manipulation for 3D visualization

Ianir Ideses, Barak Fishbain, Leonid Yaroslavsky

Proceedings Volume 7244, Real-Time Image and Video Processing 2009; 72440J (2009) https://doi.org/10.1117/12.812405
Event: IS&T/SPIE Electronic Imaging, 2009, San Jose, California, United States

Abstract

One of the key aspects of 3D visualization is computation of depth maps. Depth maps enables synthesis of 3D video from 2D video and use of multi-view displays. Depth maps can be acquired in several ways. One method is to measure the real 3D properties of the scene objects. Other methods rely on using two cameras and computing the correspondence for each pixel. Once a depth map is acquired for every frame, it can be used to construct its artificial stereo pair. There are many known methods for computing the optical flow between adjacent video frames. The drawback of these methods is that they require extensive computation power and are not very well suited to high quality real-time 3D rendering. One efficient method for computing depth maps is extraction of motion vector information from standard video encoders. In this paper we present methods to improve the 3D visualization quality acquired from compression CODECS by spatial/temporal and logical operations and manipulations. We show how an efficient real time implementation of spatial-temporal local order statistics such as median and local adaptive filtering in 3D-DCT domain can substantially improve the quality of depth maps and consequently 3D video while retaining real-time rendering. Real-time performance is achived by utilizing multi-core technology using standard parallelization algorithms and libraries (OpenMP, IPP).

Citation Download Citation

Ianir Ideses, Barak Fishbain, and Leonid Yaroslavsky "Real-time depth map manipulation for 3D visualization", Proc. SPIE 7244, Real-Time Image and Video Processing 2009, 72440J (4 February 2009); https://doi.org/10.1117/12.812405

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available