PATTERNS OF UTILIZING AI–ASSISTED TOOLS AMONG EFL STUDENTS: NEED SURVEYS FOR ASSESSMENT MODEL DEVELOPMENT

Anik Nunuk Wulyani(1), Utami Widiati(2*), Siti Muniroh(3), Clarita Dianmonica Rachmadhany(4), Nurlaila Nurlaila(5), Lina Hanifiyah(6), Tengku Intan Suzila Tengku Sharif(7),

(1) Universitas Negeri Malang, Indonesia
(2) Universitas Negeri Malang, Indonesia
(3) Universitas Negeri Malang, Indonesia
(4) Universitas Negeri Malang, Indonesia
(5) Universitas Negeri Malang, Indonesia
(6) Universitas Negeri Malang, Indonesia and Universitas Islam Negeri Maulana Malik Ibrahim Malang, Indonesia
(7) Universiti Teknologi MARA Pahang, Malaysia
(*) Corresponding Author

Abstract


This study explores patterns of AI-tool utilization among Indonesian EFL students, as preliminary data for assessment-model development. Using a convenience sampling technique, this study involved 208 university students of various year levels. A questionnaire was developed based on technology acceptance model (TAM) frameworks to collect data through Google Form, covering aspects of knowledge and use of AI tools in completing tasks, frequency of AI use and friendliness levels, reasons for using AI tools, ease of using AI tools, and desire to use AI tools. The results reveal that the participants had basic knowledge of AI but a significant number of participants admitted not knowing AI tools, suggesting the need for more education and awareness about AI. Grammarly and Google Translate were the most familiar and frequently used applications. Our findings also reveal strong relationships between perceived ease of use (PEoU) and perceived usefulness (PU) and between PU and technology acceptance (TA), implying how TAM frameworks may predict willingness to use technology-assisted or AI applications and the actual utilization. As most research participants were teacher candidates, it becomes clear that integrating AI-assisted learning content and activities appears essential as their experiences in their teacher education may influence the way they teach in the future.


Keywords


AI-assisted writing tool, ease of technology use, EFL student, technology acceptance model, technology usefulness

Full Text:

PDF

References


Al-Labadi, L., & Sant, S. (2021). Enhance learning experience using technology in class. Journal of Technology and Science Education, 11(1), 44–52. https://doi.org/10.3926/jotse.1050

Alsmari, N. A. (2019). Fostering EFL students’ paragraph writing using Edmodo. English Language Teaching, 12(10), 44-54. https://doi.org/10.5539/elt.v12n10p44

Anson, C., & Straume, I. (2022). Amazement and trepidation: Implications of AI-based natural language production for the teaching of writing. Journal of Academic Writing, 12(1), 1–9. https://doi.org/10.18552/joaw.v12i1.820.

Creswell, W. J. (2008). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (3rd ed). Upper Saddle River, NJ: Pearson International Edition.

Creswell, W. J. (2009). Research design: Qualitative, quantitative, and mixed methods approaches (3rd ed.). Thousand Oaks, CA: SAGE Publications, Inc.

Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008.

Davis, F. D., & Venkatesh, V. (1996). A critical assessment of potential measurement biases in the technology acceptance model: Three experiments. International Journal of Human-Computer Studies, 45(1), 19-45. https://doi.org/10.1006/ijhc.1996.0040.

Day, T. (2023). A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT. The Professional Geographer, 75(6), 1024–1027. https://doi.org/10.1080/00330124.2023.2190373.

Dehouche, N. (2021). Plagiarism in the age of massive generative pre-trained transformers (GPT-3). Ethics in Science and Environmental Politics, 21, 17–23. https://doi.org/10.3354/esep00195.

Evmenova, A. S., & Regan, K. (2019). Supporting the writing process with technology for students with disabilities. Intervention in School and Clinic, 55(2), 78–85. https://doi.org/10.1177/1053451219837636.

Fahmi, M. A., & Cahyono, B. Y. (2021). EFL students’ perception on the use of Grammarly and teacher feedback. JEES (Journal of English Educators Society), 6(1), 18–25. https://doi.org/10.21070/jees.v6i1.849.

Feng, H. H., Saricaoglu, A., & Chukharev-Hudilainen, E. (2016). Automated error detection for developing grammar proficiency of ESL learners. CALICO Journal, 33(1), 49–70. https://doi.org/10.1558/cj.v33i1.26507.

Fyfe, P. (2023). How to cheat on your final paper: Assigning AI for student writing. AI and Society, 38(4), 1395–1405. https://doi.org/10.1007/s00146-022-01397-z.

Le, T.-T. (2023). A preliminary example of utilizing AI text generation to support academic writing: “Humans befriending their creations: some notes on the human-AI relationship.” https://doi.org/10.31219/osf.io/uyb2p.

Liu, G., & Ma, C. (2023). Measuring EFL learners’ use of ChatGPT in informal digital learning of English based on the technology acceptance model. Innovation in Language Learning and Teaching, 18(2), 125-138. https://doi.org/10.1080/17501229.2023.2240316

Ma, Q., & Liu. L. (2004). The technology acceptance model: A meta-analysis of empirical findings. Journal of Organizational and End User Computing, 16(1), 59-72. http://www.idea-group.com

Martínez, J., López-Díaz, A., & Pérez, E. (2020). Escritura como proceso en la enseñanza de inglés como lengua extranjera. RECIE. Revista Caribeña de Investigación Educativa, 4(1), 49–61. https://doi.org/10.32541/recie.2020.v4i1.pp49-61.

Martono, M., Drajati, N. A., Rochsantiningsih, D., & Wijaya, S. A. (2023). Intertextuality in pre-service teachers’ argumentative essay in raising AI: Practices and beliefs. Register Journal, 16(2), 186–206. https://doi.org/10.18326/register.v16i2.186-205.

Marzuki, M., Widiati, U., Rusdin, D., Darwin, D., & Indrawati, I. (2023). The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective. Cogent Education, 10(2), 1-17. https://doi.org/10.1080/2331186X.2023.2236469.

Nasser, S. M. (2018). Iraqi EFL students’ difficulties in writing composition: An experimental study (University of Baghdad). International Journal of English Linguistics, 9(1), 178-184. https://doi.org/10.5539/ijel.v9n1p178.

Nguyen, M. H. (2023). Academic writing and AI: Day-1 experiment. Center for Open Science2023.

Pardede, P. (2020). Secondary school students’ perception of ICT use in EFL classroom. JET (Journal of English Teaching), 6(3), 246–259. https://doi.org/10.33541/jet.v6i3.2215.

Pinzolits, R. (2023). AI in academia: An overview of selected tools and their areas of application. MAP Education and Humanities, 4, 37–50. https://doi.org/10.53880/2744-2373.2023.4.37.

Prasetya, R. E., & Raharjo, H. (2023). Enhancing English language writing skills: An evaluation of the efficacy of Grammarly application. Journal of English Language Studies, 8(2), 320–338. https://jurnal.untirta.ac.id/index.php/JELS

Schulman, J., Zoph, B., Kim, C., Hilton, J., Menick, J., Weng, J., Uribe, J. F. C., Fedus, L., Metz, L., Pokorny, M., Lopes, R. G., Zhao, S., Vijayvergiya, A., Sigler, E., Perelman, A., Voss, C., Heaton, M., Parish, J., Cummings, R. N., Ryder, N. (2022). ChatGPT: Optimizing language models for dialogue. OpenAI.com. https://openai.com/blog/chatgpt/.

Sevcikova, B. L. (2018). Human versus automated essay scoring: A critical review. Arab World English Journal, 9(2), 157–174. https://doi.org/10.24093/awej/vol9no2.11.

Tate, T., Doroudi, S., Ritchie, D., Xu, Y., & Warschauer, M. (2023). Educational research and AI-generated writing: Confronting the coming Tsunami.

Thi, N. K., Nikolov, M., & Simon, K. (2023). Higher-proficiency students’ engagement with and uptake of teacher and Grammarly feedback in an EFL writing course. Innovation in Language Learning and Teaching, 17(3), 690–705. https://doi.org/10.1080/17501229.2022.2122476.

Tunjera, N., & Chigona, A. (2023). Investigating effective ways to use artificial intelligence in teacher education. Proceedings of the 22nd European Conference on e-Learning, ECEL, 331–340. https://doi.org/10.34190/ecel.22.1.1625.

Ulugbek, J., & Anora, J. (2019). Methods of improvement of writing. Journal of Foreign Language Teaching and Applied Linguistics, 6(3), 69-72. https://research.nu.edu.kz/ws/portalfiles/portal/17772320/Abdigapparova_Zh_2019_1_.pdf.

Wong, W. L., Muhammad, M. M., Chuah, K. P., Saimi, N., Ma’arop, A. H., & Elias, R. (2022). Did you run the telegram? Use of mobile spelling checker on academic writing. Multilingual Academic Journal of Education and Social Sciences, 10(1), 1-19. https://doi.org/10.46886/majess/v10-i1/7379.

Wu, X. (2022). Dynamic evaluation of college English writing ability based on AI technology. Journal of Intelligent Systems, 31(1), 298–309. https://doi.org/10.1515/jisys-2022-0020.

Yang, J. (2022). Perceptions of preservice teachers on AI chatbots in English education. International Journal of Internet, Broadcasting and Communication, 14(1), 44-52, http://dx.doi.org/10.7236/IJIBC.2022.14.1.44.

Yuniar, R.F., Widiati, U., & Astuti, U. P. (2019). The effect of using Wattpad on process-genre approach towards writing achievement in tertiary level. Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan, 4(7), 897–905. http://journal.um.ac.id/index.php/jptpp/.

Zhang, C., Schießl, J., Plößl, L., Hofmann, F., & Gläser-Zikuda, M. (2023). Acceptance of artificial intelligence among pre-service teachers: A multigroup analysis. International Journal of Educational Technology in Higher Education, 20(1), 1-22. https://doi.org/10.1186/s41239-023-00420-7.




DOI: https://doi.org/10.24071/llt.v27i1.7966

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Anik Nunuk Wulyani, Utami Widiati, Siti Muniroh, Clarita Dianmonica Rachmadhany, Nurlaila Nurlaila, Lina Hanifiyah, Tengku Intan Suzila Tengku Sharif

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Indexed and abstracted in:

     

 

 

LLT Journal Sinta 2 Certificate (S2 = Level 2)

We would like to inform you that LLT Journal: A Journal on Language and Language Teaching has been nationally accredited Sinta 2 by the Ministry of Education, Culture, Research and Technology of the Republic of Indonesia based on the decree  No. Surat Keputusan 158/E/KPT/2021. Validity for 5 years: Vol 23 No 1, 2020 till Vol 27 No 2, 2024

  

 

This work is licensed under CC BY-SA.

Creative Commons Attribution-ShareAlike 4.0 International License

 

Free counters!


 LLT Journal: A Journal on Language and Language Teaching, DOI: https://doi.org/10.24071/llt, e-ISSN 2579-9533 and p-ISSN 1410-7201, is published twice a year, namely in April and October by the English Language Education Study Programme of Teacher Training and Education Faculty of Sanata Dharma University, Yogyakarta, Indonesia.