Investigating the Implementation of ChatGPT in English Language Education
Effects on Student Motivation and Performance Levels
Keywords:
ChatGPT, Student Motivation, Student Performance
Abstract
In the era of rapid advancements in Artificial Intelligence (AI), ChatGPT (Chat Generative Pre-Trained Transformer) emerges as a pivotal tool reshaping educational landscapes. This research, based on self-determination theory, investigates how ChatGPT influences the motivation and academic performance of 35 seventh-semester English education students. Utilizing mixed methods, it contrasts the experiences of 25 ChatGPT users with those of 10 non-users. The quantitative analysis demonstrates notably higher levels of motivation and GPAs among ChatGPT users (with a mean motivation score of 44.88 and a mean GPA of 3.63) compared to non-users (with a mean motivation score of 17.60 and a mean GPA of 3.06). Qualitative insights highlight themes such as 'Improved Comprehension and Independent Learning' and 'Increased Academic Efficiency and Productivity,' illustrating how ChatGPT supports effective and thorough learning experiences. In keeping with the tenets of self-determination theory, these results demonstrate that ChatGPT has a beneficial effect on students' motivation. The study also recommends more experimental studies to investigate how students' motivation and performance can be improved by using ChatGPT.
References
Agus, W., Pratiwi, E., Sapan, Y. T., & Agustina, S. (2022). The Effect of SEA- Teacher Mentoring on The Students ’ Intrinsic Motivation in Teaching Practice. Journal of Teaching of English, 7(4).
Ali, J. K. M., Shamsan, M. A. A., Hezam, T. A., & Mohammed, A. A. Q. (2023). Impact of ChatGPT on Learning Motivation: Journal of English Studies in Arabia Felix, 2(1). https://doi.org/10.56540/jesaf.v2i1.51
Biro, J., Linder, C., & Neyens, D. (2023). The Effects of a Health Care Chatbot’s Complexity and Persona on User Trust, Perceived Usability, and Effectiveness: Mixed Methods Study. JMIR Human Factors, 10. https://doi.org/10.2196/41017
Bressane, A., Spalding, M., Zwirn, D., Loureiro, A. I. S., Bankole, A. O., Negri, R. G., de Brito Junior, I., Formiga, J. K. S., Medeiros, L. C. de C., Pampuch Bortolozo, L. A., & Moruzzi, R. (2022). Fuzzy Artificial Intelligence—Based Model Proposal to Forecast Student Performance and Retention Risk in Engineering Education: An Alternative for Handling with Small Data. Sustainability (Switzerland), 14(21). https://doi.org/10.3390/su142114071
C, D. P., & C, D. R. (2022). A Study of Artificial Intelligence in Education System & Role of AI in Indian Education Sector. Interantional Journal of Scientific Research in Engineering and Management, 06(03), 1–9. https://doi.org/10.55041/ijsrem11854
Cai, M. Y., Wang, J. Y., Chen, G. D., Wang, J. H., & Yang, S. H. (2020). A digital reality theater with the mechanisms of real-time spoken language evaluation and interactive switching of scenario virtual costumes: Effects on motivation and learning performance. Proceedings - IEEE 20th International Conference on Advanced Learning Technologies, ICALT 2020. https://doi.org/10.1109/ICALT49669.2020.00096
Chinonso, O. E., Theresa, A. M.-E., & Aduke, T. C. (2023). ChatGPT for Teaching, Learning and Research: Prospects and Challenges. Global Academic Journal of Humanities and Social Sciences, 5(02). https://doi.org/10.36348/gajhss.2023.v05i02.001
Corsten, D., & Skousen, B. (2023). ‘Get AI Answer?’ – Exploring the Effects of Embedding ChatGPT in Exams to Improve Student Learning Outcomes. SSRN Electronic Journal, March, 1–12. https://doi.org/10.2139/ssrn.4409035
Crawford, J., Cowling, M., & Allen, K. A. (2023). Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI). Journal of University Teaching and Learning Practice, 20(3). https://doi.org/10.53761/1.20.3.02
Fidan, M., & Gencel, N. (2022). Supporting the Instructional Videos With Chatbot and Peer Feedback Mechanisms in Online Learning: The Effects on Learning Performance and Intrinsic Motivation. Journal of Educational Computing Research, 60(7). https://doi.org/10.1177/07356331221077901
Hamilton, D., McKechnie, J., Edgerton, E., & Wilson, C. (2021). Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design. Journal of Computers in Education, 8(1). https://doi.org/10.1007/s40692-020-00169-2
Ho, V. T., Tran, V. D., & De Nguyen, V. (2023). Examining the factor structure of the teachers’ sense of efficacy scale in the Vietnamese educational context. International Journal of Education and Practice, 11(1). https://doi.org/10.18488/61.v11i1.3257
Huang, L. (2022). The Establishment of College Student Employment Guidance System Integrating Artificial Intelligence and Civic Education. Mathematical Problems in Engineering, 2022. https://doi.org/10.1155/2022/3934381
Itagi, A. R., & Tatti, V. (2015). Effective Teaching of Digital Electronics for Undergraduate Students Using a Free Circuit Simulation Software—SEQUEL. In Proceedings of the International Conference on Transformations in Engineering Education. https://doi.org/10.1007/978-81-322-1931-6_99
Jokhan, A., Chand, A. A., Singh, V., & Mamun, K. A. (2022). Increased Digital Resource Consumption in Higher Educational Institutions and the Artificial Intelligence Role in Informing Decisions Related to Student Performance. Sustainability (Switzerland), 14(4). https://doi.org/10.3390/su14042377
Jou, Y. T., Mariñas, K. A., & Saflor, C. S. (2022). Assessing Cognitive Factors of Modular Distance Learning of K‐12 Students Amidst the COVID‐19 Pandemic towards Academic Achievements and Satisfaction. Behavioral Sciences, 12(7). https://doi.org/10.3390/bs12070200
Juliana, R., Rohmana, & Agustina, S. (2022). The Corelation between Students Motivation and their English Learning Achievement during COVID-19 Pandemic. Journal of Teaching of English, 7(4), 70–77.
Kappe, R., & Van Der Flier, H. (2012). Predicting academic success in higher education: What’s more important than being smart? European Journal of Psychology of Education, 27(4). https://doi.org/10.1007/s10212-011-0099-9
Khalaf Ismail Makhlouf, M. (2021). Effect of Artificial Intelligence-Based Application on Saudi Preparatory -Year Students’ EFL Speaking Skills at Albaha University. International Journal of English Language Education, 9(2), 36. https://doi.org/10.5296/ijele.v9i2.18782
Khanna, L., Singh, S. N., & Alam, M. (2018). Multidimensional analysis of psychological factors affecting students’ academic performance. In arXiv.
Kohnke, L. (2023). A Pedagogical Chatbot: A Supplemental Language Learning Tool. RELC Journal, 54(3). https://doi.org/10.1177/00336882211067054
Mijwil, M., Aljanabi, M., & Ali, A. H. (2023). ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information. Mesopotamian Journal of Cyber Security. https://doi.org/10.58496/mjcs/2023/004
Mirchandani, D., Lynch, R., & Hamilton, D. (2001). Using the ETS Major Field Test in Business: Implications for Assessment. Journal of Education for Business, 77(1). https://doi.org/10.1080/08832320109599671
Nagi, F., Salih, R., Alzubaidi, M., Shah, H., Alam, T., Shah, Z., & Househ, M. (2023). Applications of Artificial Intelligence (AI) in Medical Education: A Scoping Review. Studies in Health Technology and Informatics, 305. https://doi.org/10.3233/SHTI230581
Neo, M., Lee, C. P., Tan, H. Y. J., Neo, T. K., Tan, Y. X., Mahendru, N., & Ismat, Z. (2022). Enhancing Students’ Online Learning Experiences with Artificial Intelligence (AI): The MERLIN Project. International Journal of Technology, 13(5). https://doi.org/10.14716/ijtech.v13i5.5843
Ryan, R. M., & Deci, E. L. (2000). Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. Contemporary Educational Psychology, 25(1). https://doi.org/10.1006/ceps.1999.1020
Saragih, M., Sipayung, K., & Manurung, L. W. (2023). The Effect of Using Cake and ELSA Speak Application on Students’ Pronunciation Skills at the Eighth Grade of SMP Negeri 25 Medan. Journey: Journal of English Language and Pedagogy, 6(3), 634–647. https://doi.org/10.33503/journey.v6i3.3728
Siche, R., & Siche, N. (2023). The language model based on sensitive artificial intelligence - ChatGPT: Bibliometric analysis and possible uses in agriculture and livestock. Scientia Agropecuaria, 14(1). https://doi.org/10.17268/sci.agropecu.2023.010
Thorp, H. H. (2023). ChatGPT is fun, but not an author. In Science (Vol. 379, Issue 6630). https://doi.org/10.1126/science.adg7879
Ting, D. S. J., Tan, T. F., & Ting, D. S. W. (2023). ChatGPT in ophthalmology: the dawn of a new era? In Eye (Basingstoke). https://doi.org/10.1038/s41433-023-02619-4
Tiwari, R. (2023). The integration of AI and machine learning in education and its potential to personalize and improve student learning experiences. INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 07(02). https://doi.org/10.55041/ijsrem17645
Trajkovik, V., Malinovski, T., Vasileva-Stojanovska, T., & Vasileva, M. (2018). Traditional games in elementary school: Relationships of student’s personality traits, motivation and experience with learning outcomes. PLoS ONE, 13(8). https://doi.org/10.1371/journal.pone.0202172
Williams, A. E. (2023). Has OpenAI Achieved Artificial General Intelligence in ChatGPT? Artificial Intelligence and Applications, February, 1–15. https://doi.org/10.47852/bonviewaia3202751
Yin, J., Goh, T. T., Yang, B., & Xiaobin, Y. (2021). Conversation Technology With Micro-Learning: The Impact of Chatbot-Based Learning on Students’ Learning Motivation and Performance. Journal of Educational Computing Research, 59(1), 154–177. https://doi.org/10.1177/0735633120952067
Ali, J. K. M., Shamsan, M. A. A., Hezam, T. A., & Mohammed, A. A. Q. (2023). Impact of ChatGPT on Learning Motivation: Journal of English Studies in Arabia Felix, 2(1). https://doi.org/10.56540/jesaf.v2i1.51
Biro, J., Linder, C., & Neyens, D. (2023). The Effects of a Health Care Chatbot’s Complexity and Persona on User Trust, Perceived Usability, and Effectiveness: Mixed Methods Study. JMIR Human Factors, 10. https://doi.org/10.2196/41017
Bressane, A., Spalding, M., Zwirn, D., Loureiro, A. I. S., Bankole, A. O., Negri, R. G., de Brito Junior, I., Formiga, J. K. S., Medeiros, L. C. de C., Pampuch Bortolozo, L. A., & Moruzzi, R. (2022). Fuzzy Artificial Intelligence—Based Model Proposal to Forecast Student Performance and Retention Risk in Engineering Education: An Alternative for Handling with Small Data. Sustainability (Switzerland), 14(21). https://doi.org/10.3390/su142114071
C, D. P., & C, D. R. (2022). A Study of Artificial Intelligence in Education System & Role of AI in Indian Education Sector. Interantional Journal of Scientific Research in Engineering and Management, 06(03), 1–9. https://doi.org/10.55041/ijsrem11854
Cai, M. Y., Wang, J. Y., Chen, G. D., Wang, J. H., & Yang, S. H. (2020). A digital reality theater with the mechanisms of real-time spoken language evaluation and interactive switching of scenario virtual costumes: Effects on motivation and learning performance. Proceedings - IEEE 20th International Conference on Advanced Learning Technologies, ICALT 2020. https://doi.org/10.1109/ICALT49669.2020.00096
Chinonso, O. E., Theresa, A. M.-E., & Aduke, T. C. (2023). ChatGPT for Teaching, Learning and Research: Prospects and Challenges. Global Academic Journal of Humanities and Social Sciences, 5(02). https://doi.org/10.36348/gajhss.2023.v05i02.001
Corsten, D., & Skousen, B. (2023). ‘Get AI Answer?’ – Exploring the Effects of Embedding ChatGPT in Exams to Improve Student Learning Outcomes. SSRN Electronic Journal, March, 1–12. https://doi.org/10.2139/ssrn.4409035
Crawford, J., Cowling, M., & Allen, K. A. (2023). Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI). Journal of University Teaching and Learning Practice, 20(3). https://doi.org/10.53761/1.20.3.02
Fidan, M., & Gencel, N. (2022). Supporting the Instructional Videos With Chatbot and Peer Feedback Mechanisms in Online Learning: The Effects on Learning Performance and Intrinsic Motivation. Journal of Educational Computing Research, 60(7). https://doi.org/10.1177/07356331221077901
Hamilton, D., McKechnie, J., Edgerton, E., & Wilson, C. (2021). Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design. Journal of Computers in Education, 8(1). https://doi.org/10.1007/s40692-020-00169-2
Ho, V. T., Tran, V. D., & De Nguyen, V. (2023). Examining the factor structure of the teachers’ sense of efficacy scale in the Vietnamese educational context. International Journal of Education and Practice, 11(1). https://doi.org/10.18488/61.v11i1.3257
Huang, L. (2022). The Establishment of College Student Employment Guidance System Integrating Artificial Intelligence and Civic Education. Mathematical Problems in Engineering, 2022. https://doi.org/10.1155/2022/3934381
Itagi, A. R., & Tatti, V. (2015). Effective Teaching of Digital Electronics for Undergraduate Students Using a Free Circuit Simulation Software—SEQUEL. In Proceedings of the International Conference on Transformations in Engineering Education. https://doi.org/10.1007/978-81-322-1931-6_99
Jokhan, A., Chand, A. A., Singh, V., & Mamun, K. A. (2022). Increased Digital Resource Consumption in Higher Educational Institutions and the Artificial Intelligence Role in Informing Decisions Related to Student Performance. Sustainability (Switzerland), 14(4). https://doi.org/10.3390/su14042377
Jou, Y. T., Mariñas, K. A., & Saflor, C. S. (2022). Assessing Cognitive Factors of Modular Distance Learning of K‐12 Students Amidst the COVID‐19 Pandemic towards Academic Achievements and Satisfaction. Behavioral Sciences, 12(7). https://doi.org/10.3390/bs12070200
Juliana, R., Rohmana, & Agustina, S. (2022). The Corelation between Students Motivation and their English Learning Achievement during COVID-19 Pandemic. Journal of Teaching of English, 7(4), 70–77.
Kappe, R., & Van Der Flier, H. (2012). Predicting academic success in higher education: What’s more important than being smart? European Journal of Psychology of Education, 27(4). https://doi.org/10.1007/s10212-011-0099-9
Khalaf Ismail Makhlouf, M. (2021). Effect of Artificial Intelligence-Based Application on Saudi Preparatory -Year Students’ EFL Speaking Skills at Albaha University. International Journal of English Language Education, 9(2), 36. https://doi.org/10.5296/ijele.v9i2.18782
Khanna, L., Singh, S. N., & Alam, M. (2018). Multidimensional analysis of psychological factors affecting students’ academic performance. In arXiv.
Kohnke, L. (2023). A Pedagogical Chatbot: A Supplemental Language Learning Tool. RELC Journal, 54(3). https://doi.org/10.1177/00336882211067054
Mijwil, M., Aljanabi, M., & Ali, A. H. (2023). ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information. Mesopotamian Journal of Cyber Security. https://doi.org/10.58496/mjcs/2023/004
Mirchandani, D., Lynch, R., & Hamilton, D. (2001). Using the ETS Major Field Test in Business: Implications for Assessment. Journal of Education for Business, 77(1). https://doi.org/10.1080/08832320109599671
Nagi, F., Salih, R., Alzubaidi, M., Shah, H., Alam, T., Shah, Z., & Househ, M. (2023). Applications of Artificial Intelligence (AI) in Medical Education: A Scoping Review. Studies in Health Technology and Informatics, 305. https://doi.org/10.3233/SHTI230581
Neo, M., Lee, C. P., Tan, H. Y. J., Neo, T. K., Tan, Y. X., Mahendru, N., & Ismat, Z. (2022). Enhancing Students’ Online Learning Experiences with Artificial Intelligence (AI): The MERLIN Project. International Journal of Technology, 13(5). https://doi.org/10.14716/ijtech.v13i5.5843
Ryan, R. M., & Deci, E. L. (2000). Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. Contemporary Educational Psychology, 25(1). https://doi.org/10.1006/ceps.1999.1020
Saragih, M., Sipayung, K., & Manurung, L. W. (2023). The Effect of Using Cake and ELSA Speak Application on Students’ Pronunciation Skills at the Eighth Grade of SMP Negeri 25 Medan. Journey: Journal of English Language and Pedagogy, 6(3), 634–647. https://doi.org/10.33503/journey.v6i3.3728
Siche, R., & Siche, N. (2023). The language model based on sensitive artificial intelligence - ChatGPT: Bibliometric analysis and possible uses in agriculture and livestock. Scientia Agropecuaria, 14(1). https://doi.org/10.17268/sci.agropecu.2023.010
Thorp, H. H. (2023). ChatGPT is fun, but not an author. In Science (Vol. 379, Issue 6630). https://doi.org/10.1126/science.adg7879
Ting, D. S. J., Tan, T. F., & Ting, D. S. W. (2023). ChatGPT in ophthalmology: the dawn of a new era? In Eye (Basingstoke). https://doi.org/10.1038/s41433-023-02619-4
Tiwari, R. (2023). The integration of AI and machine learning in education and its potential to personalize and improve student learning experiences. INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 07(02). https://doi.org/10.55041/ijsrem17645
Trajkovik, V., Malinovski, T., Vasileva-Stojanovska, T., & Vasileva, M. (2018). Traditional games in elementary school: Relationships of student’s personality traits, motivation and experience with learning outcomes. PLoS ONE, 13(8). https://doi.org/10.1371/journal.pone.0202172
Williams, A. E. (2023). Has OpenAI Achieved Artificial General Intelligence in ChatGPT? Artificial Intelligence and Applications, February, 1–15. https://doi.org/10.47852/bonviewaia3202751
Yin, J., Goh, T. T., Yang, B., & Xiaobin, Y. (2021). Conversation Technology With Micro-Learning: The Impact of Chatbot-Based Learning on Students’ Learning Motivation and Performance. Journal of Educational Computing Research, 59(1), 154–177. https://doi.org/10.1177/0735633120952067
Published
2024-03-25
How to Cite
Afkarin, M., & Asmara, C. (2024). Investigating the Implementation of ChatGPT in English Language Education. Journey: Journal of English Language and Pedagogy, 7(1), 57-66. https://doi.org/10.33503/journey.v7i1.4000
Section
Articles
Copyright (c) 2024 Mohammad Yusfi Afkarin, Candra Hadi Asmara
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Journey: Journal of English Language and Pedagogy by http://ejurnal.budiutomomalang.ac.id/index.php/journey/index is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
