ChatGPT and Its Impact on Students Assessment Practices in the Higher Educational Sector: A Systematic Review
Downloads
Background: The proliferation of Artificial Intelligence (AI) tools such as ChatGPT is growing at a rapid pace, sparing no sector. One of the AI tools that has grown in it use across the sectors is the use of ChatGPT, a tool that mimics human like capabilities of producing ideas. However, there have been many concerns about how ChatGPT will change the higher education institutions. More worrisome is how it poses risks that compromise the integrity of academic outputs if left unregulated
Objective: This study examines the influence of ChatGPT on students’ assessment practices in the higher educational sector
Methods: The study carried out a systematic literature review by gathering data from peer reviewed academic papers. Initially, 140 research papers were identified. Thereafter, these papers went through further filtering, and 35 usable papers were selected and included in the study
Results: This study highlighted the importance of using AI tools such as ChatGPT in the higher education sector, underscoring its advantages and the threats that it poses to the sector if the use remains unregulated. The study has recommended institutional policies about the use of AI tools that must be put in place to guide academic staff, researchers and learners in the responsible use of ChatGPT for academic work.
Conclusion: “While the widespread adoption of ChatGPT is undeniable, there is an urgent need for a well-balanced regulation regarding its use within Higher Education Institutions (HEIs). Thus, future research should focus on examining the existing policies and practices related to ChatGPT ethics, privacy, and security in education and identify gaps and areas for improvement.
Keywords: ChatGPT, Artificial Intelligence, Chatbot, OpenAI, Higher Education
J. Deng and Y. Lin, "The benefits and challenges of ChatGPT: An overview," Frontiers in Computing and Intelligent Systems, vol. 2, no. 2, pp. 81-83, 2022.
Q. Zhong, L. Ding, J. Liu, B. Du, and D. Tao, "Can chatgpt understand too? a comparative study on chatgpt and fine-tuned bert," arXiv preprint arXiv:2302.10198, 2023.
D. Kalla and N. Smith, "Study and analysis of chat GPT and its impact on different fields of study," International Journal of Innovative Science and Research Technology, vol. 8, no. 3, 2023.
B. D. Lund and T. Wang, "Chatting about ChatGPT: how may AI and GPT impact academia and libraries?," Library hi tech news, vol. 40, no. 3, pp. 26-29, 2023, doi: 10.1108/LHTN-01-2023-0009.
Ö. Aydın and E. Karaarslan, "OpenAI ChatGPT generated literature review: Digital twin in healthcare," Aydın, Ö., Karaarslan, E.(2022). OpenAI ChatGPT Generated Literature Review: Digital Twin in Healthcare. In Ö. Aydın (Ed.), Emerging Computer Technologies, vol. 2, 2022, doi: 10.2139/ssrn.4308687.
D. Baidoo-Anu and L. O. Ansah, "Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning," Journal of AI, vol. 7, no. 1, pp. 52-62, 2023, doi: 10.61969/jai.1337500.
A. Lozano and C. Blanco Fontao, "Is the education system prepared for the irruption of artificial intelligence? A study on the perceptions of students of primary education degree from a dual perspective: Current pupils and future teachers," Education Sciences, vol. 13, no. 7, p. 733, 2023, doi: 10.3390/educsci13070733.
I. Adeshola and A. P. Adepoju, "The opportunities and challenges of ChatGPT in education," Interactive Learning Environments, pp. 1-14, 2023.
A. O. Ifelebuegu, P. Kulume, and P. Cherukut, "Chatbots and AI in Education (AIEd) tools: The good, the bad, and the ugly," Journal of Applied Learning and Teaching, vol. 6, no. 2, 2023.
S. Vaccino-Salvadore, "Exploring the ethical dimensions of using ChatGPT in language learning and beyond," Languages, vol. 8, no. 3, p. 191, 2023.
A. Tlili et al., "What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education," Smart Learning Environments, vol. 10, no. 1, p. 15, 2023.
C. Kooli, "Chatbots in education and research: A critical examination of ethical implications and solutions," Sustainability, vol. 15, no. 7, p. 5614, 2023.
L. Labadze, M. Grigolia, and L. Machaidze, "Role of AI chatbots in education: systematic literature review," International Journal of Educational Technology in Higher Education, vol. 20, no. 1, p. 56, 2023.
C. K. Lo, "What is the impact of ChatGPT on education? A rapid review of the literature," Education Sciences, vol. 13, no. 4, p. 410, 2023.
D. Yan, "Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation," Education and Information Technologies, vol. 28, no. 11, pp. 13943-13967, 2023.
H. Yu, "Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching," Frontiers in Psychology, vol. 14, p. 1181712, 2023.
S. Yang and C. Evans, "Opportunities and challenges in using AI chatbots in higher education," in Proceedings of the 2019 3rd International Conference on Education and E-Learning, 2019, pp. 79-83.
A. Gocen and F. Aydemir, "Artificial intelligence in education and schools," Research on Education and Media, vol. 12, no. 1, pp. 13-21, 2020.
D. Ali, Y. Fatemi, E. Boskabadi, M. Nikfar, J. Ugwuoke, and H. Ali, "ChatGPT in Teaching and Learning: A Systematic Review," Education Sciences, vol. 14, no. 6, p. 643, 2024.
A. Azaria, “ChatGPT Usage and Limitations,” Dec. 2022. [Online]. Available: https://hal.science/hal-03913837.
E. Opara, A. Mfon-Ette Theresa, and T. C. Aduke, "ChatGPT for teaching, learning and research: Prospects and challenges," Opara Emmanuel Chinonso, Adalikwu Mfon-Ette Theresa, Tolorunleke Caroline Aduke (2023). ChatGPT for Teaching, Learning and Research: Prospects and Challenges. Glob Acad J Humanit Soc Sci, vol. 5, 2023.
S. Elbanna and L. Armstrong, "Exploring the integration of ChatGPT in education: adapting for the future," Management & Sustainability: An Arab Review, vol. 3, no. 1, pp. 16-29, 2024.
G. M. Eichler and E. J. Schwarz, "What sustainable development goals do social innovations address? A systematic review and content analysis of social innovation literature," Sustainability, vol. 11, no. 2, p. 522, 2019.
R. Mallett, J. Hagen-Zanker, R. Slater, and M. Duvendack, "The benefits and challenges of using systematic reviews in international development research," Journal of development effectiveness, vol. 4, no. 3, pp. 445-455, 2012.
Z. Stapic, E. G. López, A. G. Cabot, L. de Marcos Ortega, and V. Strahonja, "Performing systematic literature review in software engineering," in Central European Conference on Information and Intelligent Systems, 2012: Faculty of Organization and Informatics Varazdin, p. 441.
A. Liberati et al., "The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration," Annals of internal medicine, vol. 151, no. 4, pp. W-65-W-94, 2009.
P. Rahmadhan, M. A. Wana, D. I. Sensuse, and R. R. Suryono, "Trends and Applications of Gamification in E-Commerce: A Systematic Literature Review," Journal of Information Systems Engineering & Business Intelligence, vol. 9, no. 1, 2023.
A. Mory-Alvarado, C. Juiz, B. Bermejo, and M. Campoverde-Molina, "Green IT in small and medium-sized enterprises: A systematic literature review," Sustainable Computing: Informatics and Systems, p. 100891, 2023.
N. Z. Maharani, S. S. Kurniawan, D. I. Sensuse, I. Eitiveni, D. S. Hidayat, and E. H. Purwaningsih, "Motivations and Potential Solutions in Developing a Knowledge Management System for Organization at Higher Education: A Systematic Literature Review," Journal of Information Systems Engineering and Business Intelligence, vol. 10, no. 2, pp. 270-289, 2024.
K. Naidu and K. Sevnarayan, "ChatGPT: An ever-increasing encroachment of artificial intelligence in online assessment in distance education," Online Journal of Communication and Media Technologies, vol. 13, no. 3, p. e202336, 2023.
N. Tunjera and A. Chigona, "Investigating Effective Ways to Use Artificial Intelligence in Teacher Education," in European Conference on e-Learning, 2023, vol. 22, no. 1, pp. 331-340.
F. A. F. Limo et al., "Personalized tutoring: ChatGPT as a virtual tutor for personalized learning experiences," Przestrzeń Społeczna (Social Space), vol. 23, no. 1, pp. 293-312, 2023.
S. Elbanna and L. Armstrong, "Exploring the integration of ChatGPT in education: adapting for the future," Management & Sustainability: An Arab Review, 2023.
C. Chaka, "Detecting AI content in responses generated by ChatGPT, YouChat, and Chatsonic: The case of five AI content detection tools," Journal of Applied Learning and Teaching, vol. 6, no. 2, 2023.
A. Bahrini et al., "ChatGPT: Applications, opportunities, and threats," in 2023 Systems and Information Engineering Design Symposium (SIEDS), 2023: IEEE, pp. 274-279.
A. Morocco-Clarke, F. A. Sodangi, and F. Momodu, "The implications and effects of ChatGPT on academic scholarship and authorship: a death knell for original academic publications?," Information & Communications Technology Law, pp. 1-21, 2023.
T. Bosch et al., "South African university students’ use of AI-powered tools for engaged learning," Available at SSRN 4595655, 2023.
Ž. Bašić, A. Banovac, I. Kružić, and I. Jerković, "ChatGPT-3.5 as writing assistance in students’ essays. Humanities and Social Sciences Communications, 10 (1), 750," ed, 2023.
M. Imran and N. Almusharraf, "Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature," Contemporary Educational Technology, vol. 15, no. 4, p. ep464, 2023.
M. M. Van Wyk, M. A. Adarkwah, and S. Amponsah, "Why all the hype about chatGPT?: Academics' views of a chat-based conversational learning strategy at an open distance e-learning institution," Open Praxis, vol. 15, no. 3, pp. 214-225, 2023.
L. Butgereit and A. van Staden, "An AI Contribution to African Economic Development Through Mother Tongue Education-A Linguistic Evaluation of an African-Based AI Mathematics Tutoring Bot," in 2023 International Conference on Information and Communication Technology for Development for Africa (ICT4DA), 2023: IEEE, pp. 7-12.
L. Kohnke, B. L. Moorhouse, and D. Zou, "ChatGPT for language teaching and learning," Relc Journal, vol. 54, no. 2, pp. 537-550, 2023.
R. Baskara, "Exploring the implications of ChatGPT for language learning in higher education," Indonesian Journal of English Language Teaching and Applied Linguistics, vol. 7, no. 2, pp. 343-358, 2023.
O. Muzurura, T. Mzikamwi, T. G. Rebanowako, and D. Mpini, "Application of Artificial Intelligence for virtual teaching assistance (Case study: Introduction to Information Technology)," International Research Journal of Engineering and Technology (IRJET), 2023.
S. Dhanalakshmi, K. Komalavalli, R. Hemalatha, and S. Kalyani, "A Study on Impact of Virtual Intelligence among the Students of Higher Education with Special Reference to Chennai City," Shanlax International Journal of Education, vol. 9, no. 3, pp. 196-200, 2021.
P. P. Ray, "ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope," Internet of Things and Cyber-Physical Systems, 2023.
D. Rozado, "Danger in the Machine: The Perils of Political and Demographic Biases Embedded in AI Systems," Manhattan Institute, 2023.
E. Sarrion, "Using ChatGPT for Text Content Creation for Businesses," in Exploring the power of ChatGPT: Applications, techniques, and implications: Springer, 2023, pp. 99-106.
A. J. Adetayo, "Artificial intelligence chatbots in academic libraries: the rise of ChatGPT," Library Hi Tech News, vol. 40, no. 3, pp. 18-21, 2023.
S. P. Singh, I. A. Khan, and S. K. Mitra, "SCOPE AND LIMITATIONS OF CHATGPT IN RESEARCH AND ACADEMIC WRITING," Digital Journal of Clinical Medicine, vol. 6, no. 1, p. 5, 2024.
I. A. Khan and N. W. Paliwal, "ChatGPT and digital inequality: A rising concern," Sch J App Med Sci, vol. 9, pp. 1646-7, 2023.
S. A. Khowaja, P. Khuwaja, and K. Dev, "Chatgpt needs spade (sustainability, privacy, digital divide, and ethics) evaluation: A review," arXiv preprint arXiv:2305.03123, 2023.
J. Dempere, K. Modugu, A. Hesham, and L. K. Ramasamy, "The impact of ChatGPT on higher education," in Frontiers in Education, 2023, vol. 8: Frontiers Media SA, p. 1206936.
X. Wu, R. Duan, and J. Ni, "Unveiling security, privacy, and ethical concerns of ChatGPT," Journal of Information and Intelligence, 2023.
D. Mhlanga, "Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning," Education, the Responsible and Ethical Use of ChatGPT Towards Lifelong Learning (February 11, 2023), 2023.
J. Yang, Y.-L. Chen, L. Y. Por, and C. S. Ku, "A systematic literature review of information security in chatbots," Applied Sciences, vol. 13, no. 11, p. 6355, 2023.
A. M. Jarrah, Y. Wardat, and P. Fidalgo, "Using ChatGPT in academic writing is (not) a form of plagiarism: What does the literature say," Online Journal of Communication and Media Technologies, vol. 13, no. 4, p. e202346, 2023.
M. Khalil and E. Er, "Will ChatGPT G et You Caught? Rethinking of Plagiarism Detection," in International Conference on Human-Computer Interaction, 2023: Springer, pp. 475-487.
M. Singh, "Maintaining the integrity of the south african university: the impact of ChatGPT on plagiarism and scholarly writing," South African Journal of Higher Education, vol. 37, no. 5, pp. 203-220, 2023.
T. Susnjak, "ChatGPT: The end of online exam integrity?," arXiv preprint arXiv:2212.09292, 2022.
A. Malik, M. L. Khan, and K. Hussain, "How is ChatGPT transforming academia? Examining its impact on teaching, research, assessment, and learning," Examining its impact on teaching, research, assessment, and learning (April 9, 2023), 2023.
P. a. Rospigliosi, "Artificial intelligence in teaching and learning: what questions should we ask of ChatGPT?," vol. 31, ed: Taylor & Francis, 2023, pp. 1-3.
G. Priyanka. "What is ChatGPT? What is its Applications in Education?" https://www.edtechreview.in/trends-insights/trends/what-is-chatgpt-applications-in-education/ (accessed 2 August, 2023).
A. M. Hasanein and A. E. E. Sobaih, "Drivers and Consequences of ChatGPT Use in Higher Education: Key Stakeholder Perspectives," European Journal of Investigation in Health, Psychology and Education, vol. 13, no. 11, pp. 2599-2614, 2023.
A. M. Bettayeb, M. Abu Talib, A. Z. Sobhe Altayasinah, and F. Dakalbab, "Exploring the impact of ChatGPT: conversational AI in education," in Frontiers in Education, 2024, vol. 9: Frontiers Media SA, p. 1379796.
Copyright (c) 2025 The Authors. Published by Universitas Airlangga.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
All accepted papers will be published under a Creative Commons Attribution 4.0 International (CC BY 4.0) License. Authors retain copyright and grant the journal right of first publication. CC-BY Licenced means lets others to Share (copy and redistribute the material in any medium or format) and Adapt (remix, transform, and build upon the material for any purpose, even commercially).
