Five Evaluation Challenges in the Face of the Emergence of Generative AI in Education

Abstract

Since November 2022, educators have been concerned about the emergence of computer services that generate texts, images, or sounds based on a simple textual request. These computer applications, referred to as Generative Artificial Intelligence (GAI), have been heavily publicized. In the area of evaluation, new challenges arise: 1) Can we determine the skills to assess in students, who are potential users of GAI ? 2) Can we differentiate between human and machine production ? 3) Can we evaluate, in substance, productions that use the form as an illusion generator ? 4) How can we realize an authentic evaluation of a student’s production ? 5) Do we know how to evaluate the educational potential of these technologies ? To address these five challenges, it is necessary to raise teachers and trainers’ awareness to the practice of ethical and formative assessment capable of harnessing these technologies to prepare students for technologies that will soon become commonplace in schools.