HDR luminance normalization via contextual facilitation in highly recurrent neuromorphic spiking networks

Alexander J. White; Chou P. Hung; Chung-Chuan Lo

doi:10.1117/12.2623789

31 May 2022 HDR luminance normalization via contextual facilitation in highly recurrent neuromorphic spiking networks

Alexander J. White, Chou P. Hung, Chung-Chuan Lo

Proceedings Volume 12124, Unmanned Systems Technology XXIV; 121240E (2022) https://doi.org/10.1117/12.2623789
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

Previous research has shown that many luminance normalization mechanisms are engaged when viewing scenes with high dynamic range (HDR) luminance. In one such phenomenon, areas of similar luminance contextually facilitate the perception of ambiguous textures. Using inspiration from biological circuitry, we developed a recurrent spiking neural network that reproduces experimental results of contextual facilitation in HDR images. The network uses correlations between luminance and texture to correctly classify and segment ambiguous textures in images. While many deep neural networks can successfully perform many types of image analysis, they have limited ability to process images under naturalistic HDR illumination, requiring millions of neurons and power hungry GPUs. It is an open question if a recurrent spiking neural network can minimize the number of neurons required to perform HDR image segmentation based on texture. To that end, we designed a biologically inspired proof-of-concept recurrent SNN that can perform such a task. The network is implemented using leaky integrate-and-fire neurons, with CuBa synapses. We use the Nengo LOIHI API to simulate the network, so it can be run on Intel’s LOIHI neuromorphic hardware. The network uses a highly recurrent structure to both group image elements based on luminance and texture, and to seamlessly combine these modalities to correctly segment ambiguous textures. Furthermore, we can continuously modulate how much luminance or texture contribute to the segmentation. We surmise that further development of this network will improve the resilience of optical flow computations under environments with complex naturalistic illumination.

Conference Presentation

Citation Download Citation

Alexander J. White, Chou P. Hung, and Chung-Chuan Lo "HDR luminance normalization via contextual facilitation in highly recurrent neuromorphic spiking networks", Proc. SPIE 12124, Unmanned Systems Technology XXIV, 121240E (31 May 2022); https://doi.org/10.1117/12.2623789

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available