ChatGPT as a Grammar Checker for Japanese English Language Learners: A Comparison with Grammarly and ProWritingAid

Authors

DOI:

https://doi.org/10.54855/acoj.231417

Keywords:

grammar checkers, ChatGPT, Grammarly, ProWritingAid, English

Abstract

The introduction of ChatGPT by OpenAI in November 2022 has garnered much discussion and debate. The technology’s potential, which generates conversations in real-time using machine learning and natural language processing methods, has led to fears of job displacement (Lowrey, 2023) and student cheating (Mitchell, 2023; Cotton et al., 2023). However, the technology has not only brought fear, but also great expectations on the potential of the technology as a helpful educational aid (Ceres, 2023) and in expanding human potential (Hoffman, 2023). In this article, the use of ChatGPT is explored as a way to help students understand and improve their English grammar in comparison with Grammarly and ProWritingAid. A short text by a Japanese university is analyzed using Grammarly, ProWritingAid, and ChatGPT. The results found that, overall, ChatGPT provides the most helpful and best overall solution in helping Japanese English Language Learners (ELLs) with their grammar. Based on the results of the ChatGPT analysis, the application was introduced to first-year Japanese university students in a paragraph writing assignment. Questionnaire results on how students felt about the use of ChatGPT as a grammar-checker are presented.

Author Biography

Ronald Schmidt-Fajlik, Ibaraki University, Japan

Dr. Ronald Schmidt-Fajlik is from Canada. He is an associate professor at Ibaraki University in Japan. He has over 25 years of English language teaching experience and holds an M.Ed. and D.Ed. in English language teaching. His research interests include intercultural communication, anxiety in English language teaching, and the application of AI tools in English language learning.

References

About Us. Grammarly. (n.d.). Retrieved February 18, 2023, from https://www.grammarly.com/about

Al-Ahdal, A. (2020, May 4). Using computer software as a tool of error analysis: Giving EFL teachers and learners a much-needed impetus. SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3570619

Blogging Tips. (n.d.). ProWritingAid: Reviewing ProWritingAid. Retrieved February 16, 2023, from https://bloggingtips.com/staff-review/prowritingaid/

Cavaleri M. R., & DianatiS. (2016). Do you want me to check your grammar again? The usefulness

of an online grammar checker as perceived by students. Journal of Academic Language

and Learning, 10(1), A223-A236. Retrieved from

https://journal.aall.org.au/index.php/jall/article/view/393

Ceres, P. (2023, January 26). CHATGPT is coming for classrooms. don't panic. Wired. Retrieved February 2, 2023, from https://www.wired.com/story/chatgpt-is-coming-for-classrooms-dont-panic/

Chen, H., Pan, J. Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing. Asian. J. Second. Foreign. Lang. Educ. 7, 34 (2022). https://doi.org/10.1186/s40862-022-00171-4

Cotton, D., Cotton, P., & Shipway, J. R. (2023). Chatting and cheating. ensuring academic integrity in the era of chatbot. https://doi.org/10.35542/osf.io/mrz8h

Chen, H., Pan, J. Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing. Asian. J. Second. Foreign. Lang. Educ. 7, 34 (2022). https://doi.org/10.1186/s40862-022-00171-4

Dizon, G., & Gayed, J. M. (2021). Examining the Impact of Grammarly on the Quality of Mobile L2 Writing. The JALT CALL Journal, 17(2), 74-92. https://doi.org/10.29140/jaltcall.v17n2.336. ISSN 1832-4215.

Fitriana, K., & Nurazni, L. (2022). Exploring students' perception of using Grammarly to check grammar in their writing. JET (Journal of English Teaching), 8(1), 15–25. https://doi.org/10.33541/jet.v8i1.3044

Ghaemi, H., & Bayati, M. (2021). Software technology and writing skills improvement of intermediate EFL learners. Journal of Research in Techno-based Language Education, 1(2), Article 2. https://doi.org/10.22034/JRTLE.2021.138945

Ghufron, M. A., & Rosyida, F. (2018). The role of Grammarly in assessing English as a foreign language (EFL) writing. Lingua Cultura, 12(4), 395. https://doi.org/10.21512/lc.v12i4.4582

Hoffman, R. (2023, January 23). The human-ai partnership. Greylock. Retrieved February 15, 2023, from https://greylock.com/greymatter/the-human-ai-partnership/

Jimenez, K. (2023, February 2). 'This shouldn't be a surprise' the education community shares mixed reactions to ChatGPT. USA Today. Retrieved February 27, 2023, from https://www.usatoday.com/story/news/education/2023/01/30/chatgpt-going-banned-teachers-sound-alarm-new-ai-tech/11069593002/

John, P., & Wolf, N. (2020). Using grammar checkers in an ESL context: An investigation of automatic corrective feedback. CALICO Journal, 37(2), 169-192. https://doi.org/10.1558/cj.36523

John, P., & Woll, N. (2020). Using grammar checkers in an ESL context. CALICO Journal, 37(2), 193–196. https://doi.org/10.1558/cj.36523

Lowrey, A. (2023, February 14). How CHATGPT will destabilize white-collar work. The Atlantic. Retrieved February 15, 2023, from https://www.theatlantic.com/ideas/archive/2023/01/chatgpt-ai-economy-automation-jobs/672767/

Lytvyn, M. (2022, October 9). Grammarly history as of 2023: How has it evolved? Become a Writer Today. Retrieved February 16, 2023, from https://becomeawritertoday.com/grammarly-history/

Mitchell, A. (2023, January 5). Professor catches a student cheating with ChatGPT: 'I feel abject

terror.' New York Post. Retrieved February 15, 2023, from

https://nypost.com/2022/12/26/students-using-chatgpt-to-cheat-professor-warns/

Nguyen, H. U., Duong, L. N., & Pham, V. P. (2022). Written corrective feedback strategies

applied by Van Lang University’s EFL lecturers in teaching online. AsiaCALL Online

Journal, 13(2), 21–41. https://doi.org/10.54855/acoj.221322

O'NeillR., & Russell. M. (2019). Grammarly: Help or hindrance? Academic Learning

Advisors’ perceptions of an online grammar checker. Journal of Academic Language and

Learning, 13(1), A88-A107. Retrieved from

https://journal.aall.org.au/index.php/jall/article/view/591

O’Neill, R., & Russell, A. (2019). Stop! Grammar time: University students’ perceptions of the automated feedback program Grammarly. Australasian Journal of Educational Technology, 35(1), 42-56. https://doi.org/10.14742/ajet.3795

Perdana, I., & Farida, M. (2019). Online grammar checkers and their use for EFL writing.

Journal of English Teaching, Applied Linguistics and Literatures (JETALL), 2(2), 67.

https://doi.org/10.20527/jetall.v2i2.7332

Pham, T. T. (2022). Promoting students’ autonomy in online classes: A study on first-year

Non-English major students at Thuongmai University. AsiaCALL Online Journal, 13(2),

–59. https://doi.org/10.54855/acoj.221323

Tokunaga, M. (2021). Investigating Fluency and Accuracy of Japanese University EFL Learners’ Spoken English Production. Journal of English teaching, 7(1), 163-178. DOI: https://doi.org/10.33541/jet.v7i2.2775

Toncic, J. (2020, August 1). Teachers, Ai Grammar Checkers, and the newest literacies: Emending Writing Pedagogy and assessment – doaj. Digital Culture & Education. https://doaj.org/article/69fe64fef90e46588b7e47e15dc1ba3c

Tran, T. M. L., & Nguyen, T. T. H. (2021). The Impacts of Technology-based Communication on EFL Students’ Writing. AsiaCALL Online Journal, 12(5), 54-76. Retrieved from https://asiacall.info/acoj/index.php/journal/article/view/80

Wahyuda, M. I. (2022, June 13). The effectiveness of Grammarly and pro writing aid application toward writing skill across students writing level of man batu students. Etheses of Maulana Malik Ibrahim State Islamic University. http://etheses.uin-malang.ac.id/36341/

Wang, X., & Zhong, W. (2022). Research and implementation of English grammar check and error correction based on Deep Learning. Scientific Programming, 2022, 1–10. https://doi.org/10.1155/2022/4082082

Yang Hye Jin. (2018). Efficiency of online grammar checker in English writing performance and students’ perceptions. Korean Journal of English Language and Linguistics, 18(3), 328–348. https://doi.org/10.15738/kjell.18.3.201809.328

Downloads

Published

07-06-2023

How to Cite

Schmidt-Fajlik, R. (2023). ChatGPT as a Grammar Checker for Japanese English Language Learners: A Comparison with Grammarly and ProWritingAid. AsiaCALL Online Journal, 14(1), 105–119. https://doi.org/10.54855/acoj.231417

Issue

Section

Research Article

Similar Articles

<< < 1 2 3 4 > >> 

You may also start an advanced similarity search for this article.