There has been widespread media commentary about the potential impact of generative Artificial Intelligence (AI) such as ChatGPT on the Education field, but little examination at scale of how educators believe teaching and assessment should change as a result of generative AI. This mixed methods study examines the views of educators (n = 318) from…

This study examines the proficiency of Chat GPT, an AI language model, in answering questions on the Situational Judgement Test (SJT), a widely used assessment tool for evaluating the fundamental competencies of medical graduates in the UK. A total of 252 SJT questions from the "Oxford Assess and Progress: Situational Judgement" Test…

The aim of this study was to investigate whether secondary science teachers had different styles of technology adoption for technology-based assessments (TBAs), and whether teachers with different adoption styles showed different patterns of beliefs, attitudes and intentions regarding TBAs. By combining the variable-centered and person-centered…

Written answers to open-ended questions can have a higher long-term effect on learning than multiple-choice questions. However, it is critical that teachers immediately review the answers, and ask to redo those that are incoherent. This can be a difficult task and can be time-consuming for teachers. A possible solution is to automate the detection…

This paper describes methods and findings from student cognitive labs, teacher cognitive labs, and test administration observations as evidence evaluated in a validity argument for a computer-based alternate assessment for students with significant cognitive disabilities. Validity of score interpretations and uses for alternate assessments based…

Technologies that enable individualization for students have significant potential in special education. Computerized Adaptive Testing (CAT) refers to digital assessments that automatically adjust their difficulty level based on students' abilities, allowing for personalized, efficient, and accurate measurement. This article examines whether CAT…

Computational Thinking (CT) skill was a part of the global framework of reference on Digital Literacy for Indicator 4.4.2, widely developed in mathematics and science learning. This study aimed to promote an assessment tool using a two-tier Computerized Adaptive Test (CAT). The study used the Design and Development Research (DDR) method with four…

This meta-analysis examines the influence of smart classrooms on students' learning outcome, synthesizing findings from 21 empirical studies. The results indicate a significant overall effect size (SMD = 1.10), suggesting that smart classrooms positively affect learning outcomes more than traditional settings. Cognitive development (SMD = 1.014)…

Curriculum-based measurement of reading (CBM-R) is a common assessment educators use to monitor student growth in broad reading skills and evaluate the effectiveness of instructional programs. Computer-adaptive tests (CATs), such as Star Reading, have been cited as a viable option to formatively assess reading growth. We used Bayesian…

Assessment makes visible what we value and reciprocally what is assessed tends to become what is taken to be of value. Building on this, it can be argued that assessment does more than measure what is present rather it 'makes up' people. This piece offers a reflective commentary some of the insights to be gained from the Research Analysis and…

The primary objective of this manuscript is to examine the online assessment and exam security procedures during the pandemic, with a particular focus on higher education. In this context, the study investigates the measures employed by instructors, the challenges they encountered, and the strategies they employed to overcome these challenges in a…

The current study aimed to explore effective strategies for preventing cheating in online examinations by surveying students to determine their cheating strategies. A total of 406 Iranian students at BA, MA, and PhD levels in four programs, including English language teaching, English literature, Linguistics, and English language translation,…

Computerized assessments and digital games have become more prevalent in childhood, necessitating a systematic investigation of the effects of gamified executive function assessments on performance and engagement. This study examined the feasibility of incorporating gamification and a machine learning algorithm that adapts task difficulty to…

Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

As a teacher in the San Antonio Independent School District, Addison Davis encountered a significant challenge--maintaining student engagement during the last periods of the school day. These periods often felt like a battle between his students' growing restlessness and his efforts to keep them focused on the content. Initially, he relied heavily…