Lightweight network research based on deep learning

Meijun Zheng; Yimin Tian; Hongmei Chen; Shuai Yang; Fangfang Song; Xue Gao

doi:10.1117/12.2631211

18 March 2022 Lightweight network research based on deep learning

Meijun Zheng, Yimin Tian, Hongmei Chen, Shuai Yang, Fangfang Song, Xue Gao

Proceedings Volume 12168, International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID 2021); 121681I (2022) https://doi.org/10.1117/12.2631211
Event: International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID 2021), 2021, Harbin, China

Abstract

Convolutional neural network models in the field of computer vision are also emerging in endlessly. From LeNet in 1998, to AlexNet, which detonated the deep learning boom in 2012, to VGG^[1] in 2014, and ResNet^[2] in 2015, the application of deep learning network models in image processing is getting better and better. Neural networks are getting larger and larger, their structures are becoming more and more complex, and the hardware resources required for prediction and training are gradually increasing. Often, deep learning neural network models can only be run on servers with high computing power. Deep convolutional neural networks have improved the performance of multiple computer vision tasks to a new level. The overall trend is to build deeper and more complex networks in order to achieve higher accuracy, but these networks may not necessarily satisfy mobile devices in terms of scale and speed requirements. Due to the limitations of hardware resources and computing power, it is difficult for mobile devices to run complex deep learning network models. Efforts are also being made in the field of deep learning to promote the miniaturization of neural networks. While ensuring the accuracy of the model, it is smaller and faster. From 2016 until now, the industry has proposed lightweight network models such as SqueezeNet^[3], ShuffleNet V1-V2^[4-5], MobileNet V1-V3^[6-8], and InceptionV1-V4^[9-12]. These models make it possible for mobile terminals and embedded devices to run neural network models. Therefore, this article compares the mainstream lightweight neural network models, analyzes and contrasts various networks, and looks forward to the future development trend of lightweight neural networks and several directions that can be studied.

Citation Download Citation

Meijun Zheng, Yimin Tian, Hongmei Chen, Shuai Yang, Fangfang Song, and Xue Gao "Lightweight network research based on deep learning", Proc. SPIE 12168, International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID 2021), 121681I (18 March 2022); https://doi.org/10.1117/12.2631211

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Convolution

Neural networks

Network architectures

Instrument modeling

Performance modeling

Visual process modeling

Machine vision

Show All Keywords

Keywords/Phrases

Search In:

Publication Years