Foreground object segmentation from binocular stereo video

Kevin Law; Stan Sclaroff

doi:10.1117/12.630207

24 October 2005 Foreground object segmentation from binocular stereo video

Kevin Law, Stan Sclaroff

Proceedings Volume 6006, Intelligent Robots and Computer Vision XXIII: Algorithms, Techniques, and Active Vision; 60060C (2005) https://doi.org/10.1117/12.630207
Event: Optics East 2005, 2005, Boston, MA, United States

Abstract

Moving cameras are needed for a wide range of applications in robotics, vehicle systems, surveillance, etc. However, many foreground object segmentation methods reported in the literature are unsuitable for such settings; these methods assume that the camera is fixed and the background changes slowly, and are inadequate for segmenting objects in video if there is significant motion of the camera or background. To address this shortcoming, a new method for segmenting foreground objects is proposed that utilizes binocular video. The method is demonstrated in the application of tracking and segmenting people in video who are approximately facing the binocular camera rig. Given a stereo image pair, the system first tries to find faces. Starting at each face, the region containing the person is grown by merging regions from an over-segmented color image. The disparity map is used to guide this merging process. The system has been implemented on a consumer-grade PC, and tested on video sequences of people indoors obtained from a moving camera rig. As can be expected, the proposed method works well in situations where other foreground-background segmentation methods typically fail. We believe that this superior performance is partly due to the use of object detection to guide region merging in disparity/color foreground segmentation, and partly due to the use of disparity information available with a binocular rig, in contrast with most previous methods that assumed monocular sequences.

Citation Download Citation

Kevin Law and Stan Sclaroff "Foreground object segmentation from binocular stereo video", Proc. SPIE 6006, Intelligent Robots and Computer Vision XXIII: Algorithms, Techniques, and Active Vision, 60060C (24 October 2005); https://doi.org/10.1117/12.630207

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available