Convolutional neural networks (CNN) has significant advantages in processing image classification and was widely used in image analysis in the fields of autonomous driving, aerospace, and biomedicine. However, image classification and analysis need large matrix multiplication, which imposes many challenges to the realization of high performance and low power consumption of CNNS. Here, a photoelectric hybrid neural network (PHNN) was developed to reduce the CNN’s power consumption. The optical interference unit (OIU) composed of Mach-Zehnder interferometers (MZI) arrays, used as convolution kernel, performs multiplication and accumulation operations. The convolution kernel is split and reorganized effectively to form a new unitary matrix to reduce the number of MZIs. Simultaneously, this method can modularize the OIU, which is beneficial to field-programmable gate array (FPGA) encoding and modulation. FPGA realizes nonlinear calculation, data scheduling and storage, and phase encoding and modulation. Our PHNN has an accuracy rate of 93.3%, which reduces power consumption by 3 times of magnitude compared with traditional electronic products.
To achieve low-power convolutional neural networks, we develop a photoelectric hybrid neural network (PHNN), which consists of the optical interference unit (OIU) and field-programmable gate array (FPGA). The OIU composed of Mach–Zehnder interferometers (MZI) arrays, used as convolution kernels, performs multiplication and accumulation operations. The convolution kernel is split and reorganized, forming a new unitary matrix, which reduces MZI quantity. FPGA realizes nonlinear calculation, data scheduling and storage, and phase encoding and modulation. Our PHNN has an accuracy rate of 88.79%, and the energy efficiency ratio is 1.73 times that of traditional electronic products.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.