Real-world pedestrian detection method enhanced by semantic segmentation

Qihua Peng

doi:10.1117/1.JEI.28.1.013008

18 January 2019 Real-world pedestrian detection method enhanced by semantic segmentation

Qihua Peng

Author Affiliations +

Journal of Electronic Imaging, Vol. 28, Issue 1, 013008 (January 2019). https://doi.org/10.1117/1.JEI.28.1.013008

Abstract

Although pedestrian detection has been largely improved with the emergence of convolutional neural networks (CNN), the performance in autonomous driving still faces various challenges, which mainly include large-scale variation, illumination variation, and occlusion of different levels. A robust pedestrian detector enhanced by semantic segmentation is proposed. Inspired by the benefits of multitask learning, our main idea lies in integrating the task of semantic segmentation into the detection framework with auxiliary supervision, inheriting the merits of the two-stream network. Specifically, anchor boxes with various scales are paved on the feature maps of a base CNN; detection is performed based on bounding box classification and regression. On the other stream, semantic segmentation is also performed based on the same feature maps. Extensive experiments on the recently published large-scale pedestrian detection benchmark, i.e., CityPersons, show that the additional supervision from semantic segmentation can significantly improve the detection accuracy without extra computational burdens during inference, which demonstrates the superiority of the proposed method.

Citation Download Citation

Qihua Peng "Real-world pedestrian detection method enhanced by semantic segmentation," Journal of Electronic Imaging 28(1), 013008 (18 January 2019). https://doi.org/10.1117/1.JEI.28.1.013008

Received: 10 August 2018; Accepted: 20 December 2018; Published: 18 January 2019

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available