Overview of Judicial Text Summarization Method
DOI:
https://doi.org/10.54097/qe1xts44Keywords:
Judicial Text Summarization, Natural Language Processing, Deep Learning.Abstract
This article delves deep into the core aspects of the task of generating judicial text summaries. Through a systematic review and distillation of existing relevant literature, the article primarily focuses on extractive text summarization techniques in both unsupervised and supervised learning contexts, conducting a multidimensional and comprehensive analysis. To begin with, the article traces the evolution of text summarization techniques and dissects the differences between extractive and generative text summarization methods, along with a comparison of various algorithms. Furthermore, it provides a detailed introduction to a pipeline judicial summary generation model that combines both extractive and generative approaches. The article also conducts an in-depth analysis of the impact of transfer learning, using three different models, on judicial text summary generation. Lastly, while acknowledging significant progress in the field, the article points out the main issues and challenges in current judicial text summarization research. It also suggests potential solutions and outlines future development trends.
Downloads
References
Yadav A.K, Maurya A.K, Ranvijay, et al. Extractive Text Summarization Using Recent Approaches: A Survey [J]. Ingénierie des Systèmes d Inf, 2021, 26 (1): 109 - 121.
Dalal V, Malik L.G. A Survey of Extractive and Abstractive Text Summarization Techniques [J]. 6th International Conference on Emerging Trends in Engineering and Technology. IEEE, 2013.
Edmundson H.P. New Methods in Automatic Extracting [J]. Journal of the ACM, 1969, 16 (2): 264 - 285.
Sarkar K. Automatic Single Document Text Summarization Using Key Concepts in Documents[J]. J Inf Process Syst, 2013, 9 (4): 602 - 620.
Mihalcea R, Tarau P. TextRank: Bringing Order into Text [C]. Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing (EMNLP). Barcelona, Spain: ACL, 2004: 404 - 411.
Gao D, Li W, You O, et al. LDA-Based Topic Formation and Topic-Sentence Reinforcement for Graph-Based Multi-document Summarization [C]. 8th Asia Information Retrieval Societies Conference (AIRS). Tianjin, China: Springer, 2012.
Rush A.M, Chopra S, Weston J. A Neural Attention Model for Abstractive Sentence Summarization[C]. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP). Lisbon, Portugal: ACL, 2015: 379 - 389.
Cheng J, Lapata M. Neural Summarization by Extracting Sentences and Words [C]. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL). Berlin, Germany: ACL, 2016: 484 - 494.
Nallapati R, Zhai F, Zhou B. SummaRuNNer: A Recurrent Neural Network Based Sequence Model for Extractive Summarization of Documents [C]. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence. San Francisco, USA: AAAI, 2017.
Chieze E, Farzindar A, Lapalme G. An Automatic System for Summarization and Information Extraction of Legal Information [J]. Lecture Notes in Computer Science, Springer, 2010.
Bhattacharya P, Poddar S, Rudra K, et al. Incorporating domain knowledge for extractive summarization of legal case documents [C]. 18th International Conference for Artificial Intelligence and Law (ICAIL). Paulo, Brazil: ACM, 2021: 22 - 31.
Jing H. Sentence Reduction for Automatic Text Summarization [C]. Proceedings of the 6 th Applied Natural Language Processing Conference (ANLP). Washington, USA: ACL, 2000: 310 - 315.
Nenkova A, Siddharthan A, McKeown K.R. Automatically Learning Cognitive Status for Multi-Document Summarization of Newswire [C]. Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing. Vancouver, Canada: ACL, 2005: 241 - 248.
Lebanoff L, Song K, Dernoncourt F, et al. Scoring Sentence Singletons and Pairs for Abstractive Summarization [C]. Proceedings of the 57 th Conference of the Association for Computational Linguistics (ACL). Florence, Italy: ACL, 2019: 2175 - 2189.
Nallapati R, Zhou B, Santos C.N, et al. Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond [C]. Proceedings of the 20 th SIGNLL Conference on Computational Natural Language Learning. Berlin, Germany: ACL, 2016: 280 - 290.
Vaswani A, Shazeer N, Parmar N, et al. Attention is All you Need [C]. Proceeding of the 31 st International Conference on Neural Information Processing Systems. Long Beach, USA: Curran Associates Inc, 2017.
Wang Y, Liu X, Gao Z. Neural Related Work Summarization with a Joint Context-driven Attention Mechanism [C]. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Brussels, Belgiun: ACL, 2018.
Duan X, Yu H, Yin M, et al. Contrastive Attention Mechanism for Abstractive Sentence Summarization [C]. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9 th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Hong Kong, China: ACL, 2019.
Song S, Huang H, Ruan T. Abstractive text summarization using LSTM-CNN based deep learning [J]. Multimed Tools Appl. 2019, 78 (1): 857 - 875.
Devlin J, Chang M.W, Lee K, et al. Bert: Pre-training of Deep Bidirectional Transformers for Language Understanding [C]. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT). Minnesota, USA: ACL, 2019.
Cai T, Shen M, Peng H, et al. Improving Transformer with Sequential Context Representations for Abstractive Text Summarization[C]. Natural Language Processing and Chinese Computing 8 th CCF International Conference (NLPCC). Dunhuang, China: Springer, 2019.
Gao Y, Xu Y, Huang H, et al. Jointly Learning Topics in Sentence Embedding for Document Summarization [J]. IEEE Trans. Knowl. Data Eng, 2020, 32 (4): 688 - 699.
Liu J, Zou Y, Zhang H, et al. Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization [J]. Findings of the Association for Computational Linguistics, ACL, 2021: 1229 - 1243.
Cui P, Hu L. Topic-Guided Abstractive Multi-Document Summarization [J]. Findings of the Association for Computational Linguistics, ACL, 2021.
LEBANOFF L, SONG K, DERNONCOURT F et al. Scoring Sentence Singletons and Pairs for Abstractive Summarization [C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Florence, Italy: Association for Computational Linguistics, 2019: 2175 – 2189.
PILAULT J, LI R, SUBRAMANIAN S et al. On Extractive and Abstractive Neural Document Summarization with Transformer Language Models [C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Online: Association for Computational Linguistics, 2020: 9308 – 9319.
LIU Y, LAPATA M. Text Summarization with Pretrained Encoders [C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019: 3721 - 3731.
SANKARAN B, MI H, AL-ONAIZAN Y et al. Temporal Attention Model for Neural Machine Translation [J]. 2016.
CRF++: Yet Another CRF toolkit [EB/OL]. [2021-01-20]. https:// taku910.github.io/crfpp/.
Jieba tokenization tool [EB/OL]. [2021-01-20]. https://github.com/fxsjy/ jieba. (Chinese Text Segmentation“Jieba”[EB/OL]. [2021-01- 20]. https://github.com/fxsjy/jieba.)
Strubell E, Verga P, Belanger D, et al. Fast and Accurate Entity Recognition with Iterated Dilated Convolutions [OL]. arXiv Preprint, arXiv: 1702. 02098.
Hinton G E, Srivastava N, Krizhevsky A, et al. Improving Neural Networks by Preventing Co-Adaptation of Feature Detectors [OL]. arXiv Preprint, arXiv: 1207. 0580.
Krizhevsky A, Sutskever I, Hinton G E. Imagenet Classification with Deep Convolutional Neural Networks[J]. Communications of the ACM, 2017, 60 (6): 84 - 90.
Huang Z H, Xu W, Yu K. Bidirectional LSTM-CRF Models for Sequence Tagging [OL]. arXiv Preprint, arXiv: 1508.01991.
Devlin J, Chang M-W, Lee K, et al. Bert: Pre-Training of Deep Bidirectional Transformers for Language Understanding [OL]. arXiv Preprint, arXiv: 1810. 04805.
Lan Z Z, Chen M D, Goodman S, et al. ALBERT: A Lite Bert for Self-Supervised Learning of Language Representations [OL]. arXiv Preprint, arXiv: 1909. 11942.
Eziz E. Kashgari [EB/OL]. [2021-01-20]. https://github. com/ BrikerMan/Kashgari.
Maoran, Wang Yilei, Gao Song, et al. A Deep-Learning Model Based on Attention Mechanism for Chinese Comparative Relation Detection [J]. Journal of the China Society for Scientific and Technical Information, 2019, 38 (6): 612 - 621.)
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Highlights in Science, Engineering and Technology
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
