Research on the Application of Deep Learning in Natural Language Processing

Fangxu Yan; Jianhui Wang; Wei Li

doi:10.54097/m9sxpv44

Authors

Fangxu Yan
Jianhui Wang
Wei Li

DOI:

https://doi.org/10.54097/m9sxpv44

Keywords:

Deep Learning, Natural Language Processing, Neural Network

Abstract

Deep learning is a kind of machine learning, which is the necessary path to realize artificial intelligence. The application of deep learning in the field of natural language processing has gone far beyond the limitations of traditional methods, showing unparalleled advantages such as automatically learning abstract features from the original data to form preciser representation. This paper aims to analyze the application of deep learning in natural language processing, and provides reference for the follow-up research and development in this field.

Downloads

Download data is not yet available.

References

[1] Hinton G E, Salakhutdinov R R. Reducing the dimensionality of data with neural networks[J]. science, 2006, 313(5786): 504-507.

[2] Chen W. Research on Artificial Intelligence in Natural Language Processing[J]. Information Recording Materials, 2023, 24 (10) : 92-94.

[3] Wei J, Liu A, Tang J. Research on alarm model of digital TV monitoring platform based on deep learning neural network technology[J]. Cable TV technology, 2017, (07) : 78-82.

[4] LeCun Y, Bottou L, Bengio Y, et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE, 1998, 86(11): 2278-2324.

[5] Yan F, Wang J. Research on Sentiment Analysis of Micro-blog based on Attention-BiLSTM[J]. Frontiers in Computing and Intelligent Systems, 2024, 7(3): 49-51.

[6] Collobert R, Weston J, Bottou L, et al. Natural language processing (almost) from scratch[J]. Journal of machine learning research, 2011, 12: 2493− 2537.

[7] Kalchbrenner N, Grefenstette E, Blunsom P. A convolutional neural network for modelling sentences[J]. arXiv:1404.2188v1, 2014.

[8] Mikolov T, Kombrink S, Burget L, et al. Extensions of recurrent neural network language model[C]//2011 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, 2011: 5528-5531.

[9] Sutskever I, Vinyals O, Le Q V. Sequence to sequence learning with neural networks[J]. Advances in neural information processing systems, 2014, 27.

[10] Devlin J. Bert: Pre-training of deep bidirectional transformers for language understanding[J]. arXiv:1810.04805, 2018.

[11] Raffel C, Shazeer N, Roberts A, et al. Exploring the limits of transfer learning with a unified text-to-text transformer[J]. Journal of machine learning research, 2020, 21(140): 1-67.