The Advance of Deep Learning Based Named Entity Recognition
DOI:
https://doi.org/10.54097/hset.v12i.1368Keywords:
Named Entity Recognition, Natural Language Processing, Deep Learning, Machine LearningAbstract
Named Entity Recognition is a well-known research direction in the area of deep learning. It takes an essential role in natural language processing. The goal of the Named Entity Recognition is to identify and separate the named entities, such as a person, location, or name, from the entire text. In addition, the deep learning model has achieved remarkable achievements in many other areas, and the deep learning-based named entity recognition method has reached an F score of over 90. The paper summarizes the development of named entity recognition and puts forward a recurrent neural network-based named entity recognition algorithm. The result shows that improving the performance of the Named Entity Recognition model by simply enriching the number and variety of the input datasets or providing the model with substantial computing resources for training is nearly impossible without a significant breakthrough. There still requires another way to improve the NER model in future research.
Downloads
References
Baevski, A., Edunov, S., Liu, Y., Zettlemoyer, L., & Auli, M. (2019, November). Cloze-driven Pretraining of Self-attention Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) (pp. 5360-5369).
Akbik, A., Blythe, D., & Vollgraf, R. (2018, August). Contextual string embeddings for sequence labeling. In Proceedings of the 27th international conference on computational linguistics (pp. 1638-1649).
Zhang W E, Sheng Q Z, Alhazmi A, et al. Adversarial attacks on deep-learning models in natural language processing: A survey[J]. ACM Transactions on Intelligent Systems and Technology (TIST), 2020, 11(3): 1-41.
Lample G, Ballesteros M, Subramanian S, et al. Neural Architectures for Named Entity Recognition[C]//Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2016: 260-270.
Ma X, Hovy E. End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2016: 1064-1074.
Yang Z, Salakhutdinov R, Cohen W W. Transfer learning for sequence tagging with hierarchical recurrent networks[J]. arXiv preprint arXiv:1703.06345, 2017.
Ye Z, Ling Z H. Hybrid semi-Markov CRF for Neural Sequence Labeling[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). 2018: 235-240.
Wu M, Liu F, Cohn T. Evaluating the Utility of Hand-crafted Features in Sequence Labelling[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 2018: 2850-2856.
Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019, June). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (pp. 4171-4186).
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.
Akbik A, Blythe D, Vollgraf R. Contextual string embeddings for sequence labeling[C]//Proceedings of the 27th International Conference on Computational Linguistics. 2018: 1638-1649.
Jia, C., Shi, Y., Yang, Q., & Zhang, Y. (2020, November). Entity enhanced BERT pre-training for Chinese NER. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 6384-6396).
Taher, E., Hoseini, S. A., & Shamsfard, M. (2019). Beheshti-NER: Persian named entity recognition Using BERT. In Proceedings of The First International Workshop on NLP Solutions for Under Resourced Languages (NSURL 2019) co-located with ICNLSP 2019-Short Papers (pp. 37-42).
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
