Not quite eye to A.I.: student and teacher perspectives on the use of generative artificial intelligence in the writing process
Tóm tắt
Generative artificial intelligence (GenAI) can be used to author academic texts at a similar level to what humans are capable of, causing concern about its misuse in education. Addressing the role of GenAI in teaching and learning has become an urgent task. This study reports the results of a survey comparing educators’ (n = 68) and university students’ (n = 158) perceptions on the appropriate use of GenAI in the writing process. The survey included representations of user prompts and output from ChatGPT, a GenAI chatbot, for each of six tasks of the writing process (brainstorming, outlining, writing, revising, feedback, and evaluating). Survey respondents were asked to differentiate between various uses of GenAI for these tasks, which were divided between student and teacher use. Results indicate minor disagreement between students and teachers on acceptable use of GenAI tools in the writing process, as well as classroom and institutional-level lack of preparedness for GenAI. These results imply the need for explicit guidelines and teacher professional development on the use of GenAI in educational contexts. This study can contribute to evidence-based guidelines on the integration of GenAI in teaching and learning.
Tài liệu tham khảo
Carlson, M., Pack, A. & Escalante, J. (2023). Utilizing OpenAI’s GPT-4 for written feedback. TESOL Journal. https://doi.org/10.1002/tesj.759
Baker, R. S., & Hawn, A. (2021). Algorithmic bias in education. International Journal of Artificial Intelligence in Education, 32, 1052–1092. https://doi.org/10.1007/s40593-021-00285-9
Bland, J., & Altman, D. (1997). Statistics notes: Cronbach’s alpha. BMJ, 314, 275. https://doi.org/10.1136/bmj.314.7080.572
Bonner, E., Lege, R., & Frazier, E. (2023). Large language model-based artificial intelligence in the language classroom: Practical ideas for teaching. Teaching English with Technology, 23(1), 23–41. https://doi.org/10.56297/BKAM1691/WIEO1749
Bridgeman, B., Trapani, C., & Attali, Y. (2012). Comparison of human and machine scoring of essays: Differences by gender, ethnicity, and country. Applied Measurement in Education, 25(1), 27–40. https://doi.org/10.1080/08957347.2012.635502
Chan, C. Y. K. (2023). A comprehensive AI policy education framework for university teaching and learning. [preprint in arXiv]. https://doi.org/10.48550/arXiv.2305.00280
Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence, 4, 100118. https://doi.org/10.1016/j.caeai.2022.100118
Chomsky, N. (1991). Linguistics and cognitive science: Problems and mysteries. In Aka Kasher (Ed.), The Chomskyan Turn. Blackwell. pp. 26–53.
CWPA, NCTE & NWP. (2011). National Framework for success in postsecondary writing. Council of Writing Program Administrators, the National Council of Teachers of English, and the National Writing Project. http://wpacouncil.org/files/framework-for-success-postsecondarywriting.pdf
Dehouche, N. (2021). Plagiarism in the age of massive generative pre-trained transformers (GPT-3). Ethics in Science and Environmental Politics, 21, 17–23. https://doi.org/10.3354/esep00195
Ely, J. J., Henderson, L., & Wachsman, Y. (2013). Testing the effectiveness of the university honor code. Academy of Educational Leadership Journal, 17(4), 95–104.
Evering, L. C., & Moorman, G. (2012). Rethinking plagiarism in the digital age. Journal of Adolescent & Adult Literacy, 56(1), 35–44. https://doi.org/10.1002/JAAL.00100
Fan, N. (2023). Exploring the effects of automated written corrective feedback on EFL students’ writing quality: A mixed-methods study. SAGE Open. https://doi.org/10.1177/21582440231181296
Farrokhnia, M., Banihashem, S. K., Norooz, O. I., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2195846
Fitria, T. N. (2021). “Grammarly” as AI-powered English writing assistant: Students’ alternative for English writing. Metathesis Journal of English Language LIterature and Teaching, 5(1), 65–78. https://doi.org/10.31002/metathesis.v5i1.3519
Gardner, J., O’Leary, M., & Yuan, L. (2020). Artificial intelligence in educational assessment: ‘Breakthrough? Or buncombe and ballyhoo?’ Journal of Computer Assisted Learning, 37, 1207–1216. https://doi.org/10.1111/jcal.12577
Godwin-Jones, R. (2022). Partnering with AI: Intelligent writing assistance and instructed language learning. Language Learning & Technology, 26(2), 5–24.
Graham, M., De Sabbata, S., & Zook, M. A. (2015). Towards a study of information geographies: (im)mutable augmentations and a mapping of the geographies of information. Geography and Environment, 2(1), 88–105. https://doi.org/10.1002/geo2.8
Graham, S. (2019). Changing how writing is taught. Review of Research in Education, 43(1), 277–303. https://doi.org/10.3102/0091732X18821125
Graham, S., Kiuhara, S. A., & MacKay, M. (2020). The effects of writing on learning in science, social studies, and mathematics: A meta-analysis. Review of Educational Research, 90(2), 179–226. https://doi.org/10.3102/0034654320914744
Hockley, N. (2018). Automated writing evaluation. ELT Journal, 73(1), 82–88. https://doi.org/10.1093/elt/ccy044
Hu, K. (2023). ChatGPT sets record for fastest-growing user base—Analyst note. Reuters. https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/
Huawei, S., & Aryadoust, V. (2023). A systematic review of automated writing evaluation systems. Education and Information Technologies, 28, 771–795. https://doi.org/10.1007/s10639-022-11200-7
Ingley, S. J., & Pack, A. (2023). Leveraging AI tools to develop the writer rather than the writing. Trends in Ecology & Evolution, 38(9):785–787. https://doi.org/10.1016/j.tree.2023.05.007
Jackson, M. C. (2021). Artificial intelligence and algorithmic bias: The issue with technology reflecting history and humans. Journal of Business & Technology Law, 16(2), 299–316.
Kasneci, E., Sessler, K., Kuchemann, S., Bannert, M., Dementieva, D., Fischer, F., Grasser, U., Groh, G., Gunnemann, S., Hullermeier, E., Krusche, S., Kutynoik, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunity and challenges of large language models for education. Learning and Individual Differences. https://doi.org/10.1016/j.lindif.2023.102274
Kaplan, A., & Haenlein, M. (2018). Siri, Siri, in my hand: Who’s the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence. Business Horizons, 62(1), 15–25. https://doi.org/10.1016/j.bushor.2018.08.004
Konheim-Kalkstein, Y. L., Stellmack, M. A., & Shilkey, M. L. (2008). Comparison of honor code and non-honor code classrooms at non-honor code university. Journal of College and Character. https://doi.org/10.2202/1940-1639.1115
Kumar, R. (2023). Faculty members’ use of artificial intelligence to grade student papers: a case of implications. International Journal for Educational Integrity. https://doi.org/10.1007/s40979-023-00130-7
Lampropoulos, G., Ferdig, R. E., & Kaplan-Rakowski, R. (2023). A social media data analysis of general and educational use of ChatGPT: Understanding emotional educators. SSRN. https://doi.org/10.2139/ssrn.4468181
Lo, C. K. (2023). What is the impact of ChatGPT on Education? A rapid review of the literature. Education Science. https://doi.org/10.3390/educsci13040410
National Council of Teachers of English. (2013). NCTE position statement on machine scoring. https://ncte.org/statement/machine_scoring/
O’Neill, R., & Russell, A. (2019). Stop! Grammar time: University students’ perceptions of the automated feedback program Grammarly. Australasian Journal of Educational Technology, 35(1), 42–56. https://doi.org/10.14742/ajet.3795
OpenAI. (2023). Terms of use. https://openai.com/policies/terms-of-use. Accessed 4 Jul 2023.
Pack, A. & Maloney, J. (2023a). Using generative artificial intelligence for language education research: Insights from using OpenAI’s ChatGPT. TESOL Quarterly. https://doi.org/10.1002/tesq.3253
Pack, A., & Maloney, J. (2023b). Potential affordances of generative AI in language education: Demonstrations and an evaluative framework. Teaching English with Technology, 23(2), 4–24. doi: 10.56297/buka4060/vrro1747
Pennycook, A. (1996). Borrowing others’ words: Text, ownership, memory, and plagiarism. TESOL Quarterly, 30(2), 201–230.
Sadeghi, R. (2019). The attitude of scholars has not changed towards plagiarism since the medieval period: Definition of plagiarism according to Shams-e-Qays, thirteenth-century Persian literary scientist. Research Ethics, 15(2), 1–3. https://doi.org/10.1177/1747016116654065
Seow, A. (2002). The writing process and process writing. In J. C. Richards & W. A. Renandya (Eds.), Methodology in language teaching: An anthology of current practice (pp. 315–320). Cambridge University Press.
Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Applied Learning & Teaching. https://doi.org/10.37074/jalt.2023.6.1.17
Sutherland-Smith, W. (2005). Pandora’s box: Academic perceptions of student plagiarism in writing. Journal of English for Academic Purposes, 4, 83–95. https://doi.org/10.1016/j.jeap.2004.07.007
Tatum, H. E. (2022). Honor codes and academic integrity: Three decades of research. Journal of College and Character, 23(1), 32–47. https://doi.org/10.1080/2194587X.2021.2017977
Tseng, W., & Warschauer, M. (2023). AI-writing tools in education: If you can’t beat them, join them. Journal of China Computer-Assisted Language Learning. https://doi.org/10.1515/jccall-2023-0008
Urlaub, P., & Dessein, E. (2022). From disrupted classrooms to human-machine collaboration? The pocket calculator, Google Translate, and the future of language education. L2 Journal, 14(1), 45–59. https://doi.org/10.5070/L214151790
Wang, Z., & Han, F. (2022). The effects of teacher feedback and automated feedback on cognitive and psychological aspects of foreign language writing: A mixed-methods research. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2022.909802
Weigle, S. C. (2013). English as a second language writing and automated essay evaluation. In M. D. Shermis & J. Burstein (Eds.), The handbook of automated essay evaluation: Current applications and new directions. Routledge.
Yang, M. (2023). New York City schools ban AI chatbot that writes essays and answers prompts. The Guardian. https://www.theguardian.com/us-news/2023/jan/06/new-york-city-schools-ban-ai-chatbot-chatgpt
Yeo, M. A. (2023). Academic integrity in the age of artificial intelligence (AI) authoring apps. TESOL Journal. https://doi.org/10.1002/tesj.716
Yeo, S. (2007). First-year university science and engineering students’ understanding of plagiarism. Higher Education Research & Development, 26(2), 199–216. https://doi.org/10.1080/07294360701310813
Yeo, S., & Chien, R. (2007). Evaluation of a process and proforma for making consistent decisions about the seriousness of plagiarism incidents. Quality in Higher Education, 13(2), 187–204. https://doi.org/10.1080/13538320701629202
Yu, H., & Guo, Y. (2023). Generative artificial intelligence empowers educational reform: Current status, issues, and prospects. Frontiers in Education, 8, 1183162. https://doi.org/10.3389/feduc.2023.1183162
Zhang, Z. V. (2020). Engaging with automated writing evaluation (AWE) feedback on L2 writing: Student perceptions and revisions. Assessing Writing. https://doi.org/10.1016/j.asw.2019.100439