Embedded implementation of a random feature detecting network for real-time classification of time-of-flight SPAD array recordings

Joyce Mau; Saeed Afshar; Tara Julia Hamilton; André van Schaik; Rudi Lussana; Aaron Panella; Jochen Trumpf; Dennis Delic

doi:10.1117/12.2517875

2 May 2019 Embedded implementation of a random feature detecting network for real-time classification of time-of-flight SPAD array recordings

Joyce Mau, Saeed Afshar, Tara Julia Hamilton, André van Schaik, Rudi Lussana, Aaron Panella, Jochen Trumpf, Dennis Delic

Author Affiliations +

Proceedings Volume 11005, Laser Radar Technology and Applications XXIV; 1100505 (2019) https://doi.org/10.1117/12.2517875
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

A real time program is implemented to classify different model airplanes imaged using a 32x32 SPAD array camera in time-of-flight mode. The algorithm uses random feature extractors in series with a linear classifier and is implemented on the NVIDIA Jetson TX2 platform, a power efficient embedded computing device. The algorithm is trained by calculating the classification matrix using a simple pseudoinverse operation on collected image data with known corresponding object labels. The implementation in this work uses a combination of serial and parallel processes and is optimized for classifying airplane models imaged by the SPAD and laser system. The performance of different numbers of convolutional filters is tested in real time. The classification accuracy reaches up to 98.7% and the execution time on the TX2 varies between 34.30 and 73.55 ms depending on the number of convolutional filters used. Furthermore, image acquisition and classification use 5.1 W of power on the TX2 board. Along with its small size and low weight, the TX2 platform can be exploited for high-speed operation in applications that require classification of aerial targets where the SPAD imaging system and embedded device are mounted on a UAS.

Conference Presentation

Citation Download Citation

Joyce Mau, Saeed Afshar, Tara Julia Hamilton, André van Schaik, Rudi Lussana, Aaron Panella, Jochen Trumpf, and Dennis Delic "Embedded implementation of a random feature detecting network for real-time classification of time-of-flight SPAD array recordings", Proc. SPIE 11005, Laser Radar Technology and Applications XXIV, 1100505 (2 May 2019); https://doi.org/10.1117/12.2517875

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available