A Presentation of Structures and Applications of Convolutional Neural Networks

Authors

  • Minghao Bai
  • Muxian Li

DOI:

https://doi.org/10.54097/hset.v61i.10291

Keywords:

Structure, Application, Convolutional Neural Network.

Abstract

This paper reviewed the history of convolutional neural networks, why and how they developed, and what inspired the scientists to design them. To make CNNs simpler to understand, we wrote about their characteristics and structures while introducing the basic units of convolutional neural networks, including training and modeling parameters and how they would affect the confidence and efficiency of the whole process, different kinds of layers and how they work, multiple pooling methods and loss functions with their formulas. This paper also included applications of convolutional neural networks in computer vision and natural language processing while specifying and analyzing the technologies in use to clarify this introduction. Challenges and future research directions of the convolutional neural networks were pointed out to help refine this technique.

Downloads

Download data is not yet available.

References

Collobert R, and Weston J 2008 A unified architecture for natural language processing Proceedings of the 25th International Conference on Machine Learning - ICML ’08.

Mostafa S and Wu F X 2021 Diagnosis of autism spectrum disorder with convolutional autoencoder and structural MRI images Neural Engineering Techniques for Autism Spectrum Disorder 23 – 38.

Szegedy C, Vanhoucke V, Ioffe S, Shlens J and Wojna Z 2016 Rethinking the Inception Architecture for Computer Vision IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016 2818 - 26.

Gong Y, Wang L, Guo R and Lazebnik S 2014 Multi-scale Orderless Pooling of Deep Convolutional Activation Features Computer Vision – ECCV 2014 392 – 407.

Deng J, Guo J, Yang J, Xue N, Cotsia I and Zafeiriou S P 2021 ArcFace: Additive Angular Margin Loss for Deep Face Recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 1.

Lu H and Zhang Q 2016 Applications of deep convolutional neural network in computer vision 1 - 17.

Krizhevsky A, Sutskever I and Hinton G E 2012 ImageNet classification with deep convolutional neural networks Communications of the ACM 60 84 – 90.

Simonyan K and Zisserman A 2014 Very Deep Convolutional Networks for Large-Scale Image Recognition.

Szegedy C, Liu W, Jia Y Q, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V and Rabinovich A 2015 Going deeper with convolutions 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 7 – 12.

Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J and Chen T 2018 Recent advances in convolutional neural networks Pattern Recognition 77 354 - 77.

Downloads

Published

30-07-2023

How to Cite

Bai, M., & Li, M. (2023). A Presentation of Structures and Applications of Convolutional Neural Networks. Highlights in Science, Engineering and Technology, 61, 180-187. https://doi.org/10.54097/hset.v61i.10291