Comparing the Paraphrasing Ability of ChatGPT and Kimi AI in Jane Eyre：a Qualitative Study
DOI:
https://doi.org/10.54097/58nrg156Keywords:
Large Language Models (LLMs), ChatGPT, Kimi AI, Paraphrase Generation, Linguistics, Comparison, Comparative Linguistics.Abstract
This study compares the paraphrasing abilities of ChatGPT and Kimi AI in Jane Eyre, based on a linguistic typology standard. Firstly, the data shows a general paraphrasing situation across each facet of the standard, demonstrating the two Large Language Models(LLMs) performed better in their original source languages, English and Chinese. Subsequently, qualitative case studies demonstrate the discrepancy of single quantitative study and delves deeper into the English-Chinese comparison behind the behaviour of the two models, which is analyzed with comparative Linguistics, advanced translation studies and even Literature theories. The results demonstrate that English is more hypotactic, using more variations of words or clause to express compared to Chinese. Chinese, on the other hand, is more paratactic, requiring more modifiers to concretize the same expression. In conclusion, this paper sheds light on and contributes to the linguistic characteristics of the source languages in developing and refining LLMs for NLP tasks. Meanwhile, concerns are raised about the limitations due to the limited case study and translation deviation. Additionally, this paper rasies suggestions for future AI modification and personalizes development of future LLMs and AI.
Downloads
References
[1] Witteveen, S. and Andrews, M. (2019) Paraphrasing with large language models, arXiv.org. Available at: https://arxiv.org/abs/1911.09661
[2] Hongwu Qin and Kefei Wang (2009) Comparison and Translation between English and Chinese Foreign Language Teaching and Research Press.
[3] Yan Li (2024) Domestic large models begin to "roll" long texts, why is Kimi so popular cnki.net. Available at: http://www.cnki.net
[4] Sandler, M. et al. (2024) A linguistic comparison between human and CHATGPT-generated conversations, arXiv.org. Available at: https://arxiv.org/abs/2401.16587
[5] Li, L. et al. (2023) Evaluation on CHATGPT for Chinese language understanding | data intelligence | MIT press, direct.mit.edu. Available at: https://direct.mit.edu/dint/article/5/4/885/117502/Evaluation-on-ChatGPT-for-Chinese-Language
[6] Brianna Elizabeth O'Boyle (2024) FROM WIKI OR CHATGPT? PERCEPTIONS OFAI-GENERATED TEXT ProQuest. Available at: https://digitalcollections.sdsu.edu/do/b0b04f84-a566-49a0-9faf-5e2f8a93a5b5
[7] Mohammad Awad AlAfnan (2024), Large Language Models as Computational Linguistics Tools: A Comparative Analysis of ChatGPT and Google Machine Translations, Journal of Artificial Intelligence and Technology , Available at: https://doi.org/10.37965/jait.2024.0549
[8] Altameemi, Y.M. (2024) State-of-the-art review of the Corpus Linguistics Field from the beginning until the development of chatgpt, Theory and Practice in Language Studies. Available at: https://tpls.academypublication.com/index.php/tpls/article/view/7313
[9] Kurt Pehlivanoglu, M., Gobosho, R. T., Syakura, M. A., Shanmuganathan, V., & de-la-Fuente-Valentín, L. (2024). Comparative analysis of paraphrasing performance of ChatGPT, GPT-3, and T5 language models using a new ChatGPT generated dataset: ParaGPT. Expert Systems, e13699. Available at: https://doi.org/10.1111/exsy.13699
[10] Zhong, Q. et al. (2023) Can CHATGPT understand too? A comparative study on CHATGPT and fine-tuned Bert, arXiv.org. Available at: https://arxiv.org/abs/2302.10198
[11] Walelign, T.S. and Laszlo, k (2024) A Comparative Study of ChatGPT-based and Hybrid Parser-based Sentence Parsing Methods for Semantic Graph-based Induction ResearchGate. Available at: https://www.researchgate.net/publication/377867128_A_Comparative_Study_of_ChatGPT-Based_and_Hybrid_Parser-based_Sentence_Parsing_Methods_for_Semantic_Graph-Based_Induction
[12] Borji, A. and Mohammadian, M. (2023) Battle of the wordsmiths: Comparing chatgpt, GPT-4, claude, and Bard, SSRN. Available at: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4476855
[13] Mori, M. (2019) Pluralizing the paraphrase: Reconsidering meaning via a typology of linguistic changes, wiley online library. Available at: https://onlinelibrary.wiley.com/doi/10.1002/tesq.514
[14] Yinghui Tian, Limin Li () A Corpus-based Analysis of the language Features and Plot Representation in Jane Eyre. Atlantis Press Available at: https://www.atlantis-press.com/proceedings/iclahd-23/125996422
[15] Xin Zhou (2018) A comparative study of English and Chinese on abstract and concrete expressions--taking "Jane Eyre" as an exampleChina Academic Journal Electronic Publishing House. Available at: http://www.cnki. net.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Journal of Education, Humanities and Social Sciences
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
