The application of Automated Writing Evaluation (AWE) has recently gained researchers' attention worldwide. However, the impact of AWE feedback on student writing, particularly in languages other than English, remains controversial. This study aimed to compare the impacts of Chinese AWE feedback and teacher feedback on Chinese writing revision,…

Knowledge tracing (KT) is a method to evaluate a student's knowledge state (KS) based on their historical problem-solving records by predicting the next answer's binary correctness. Although widely applied to closed-ended questions, it lacks a detailed option tracing (OT) method for assessing multiple-choice questions (MCQs). This paper introduces…

In the 21st century, the urgent educational demand for cultivating complex skills in vocational training and learning is met with the effectiveness of the four-component instructional design model. Despite its success, research has identified a notable gap in the address of formative assessment, particularly within computer-supported frameworks.…

This study examined the effect of mobile-mediated dynamic assessment on reading comprehension and reading fluency skills of Iranian L2 learners. With 50 Iranian L2 learners, randomly assigned to the experimental and control groups, a pretest-posttest control group design was used. Whereas the control group received traditional instructor…

This paper provides some insights into the use of example-generating tasks in the design of a technology-rich learning environment to enhance students' mathematical thinking. The paper reports on an early stage of a design-based research project concerning the design of tasks and associated feedback utilising the affordances provided by a combined…

Remote proctoring, or monitoring test takers through internet-based, video-recording software, has become critical for maintaining test security on high-stakes assessments. The main role of remote proctors is to make judgments about test takers' behaviors and decide whether these behaviors constitute rule violations. Variability in proctor…

Questionnaires are by far the most common tool for measuring noncognitive constructs in psychology and educational sciences. Response bias may pose an additional source of variation between respondents that threatens validity of conclusions drawn from questionnaire data. We present a mixture modeling approach that leverages response time data from…

With the recent and rapid transition to online teaching and learning in higher education, this explanatory study investigated the key design considerations used by business educators designing assessments suitable for online delivery. From a comprehensive literature review, we identified five key design considerations for online assessments: they…

As a result of the COVID-19 pandemic, online assessment has become pivotal to allow evaluation of the knowledge and competences of teachers-to-be. In this context, this study explored language teacher educators' conceptions and practices of online assessment and the implications of this type of assessment for language teacher education. Forty-six…

"Tests of Aptitude for Language Learning" (TALL) is an openly accessible internet-based battery to measure the multifaceted construct of foreign language aptitude, using language domain-specific instruments and L1-sensitive instructions and stimuli. This brief report introduces the components of this theory-informed battery and…

There has been widespread media commentary about the potential impact of generative Artificial Intelligence (AI) such as ChatGPT on the Education field, but little examination at scale of how educators believe teaching and assessment should change as a result of generative AI. This mixed methods study examines the views of educators (n = 318) from…

This study examines the proficiency of Chat GPT, an AI language model, in answering questions on the Situational Judgement Test (SJT), a widely used assessment tool for evaluating the fundamental competencies of medical graduates in the UK. A total of 252 SJT questions from the "Oxford Assess and Progress: Situational Judgement" Test…

The aim of this study was to investigate whether secondary science teachers had different styles of technology adoption for technology-based assessments (TBAs), and whether teachers with different adoption styles showed different patterns of beliefs, attitudes and intentions regarding TBAs. By combining the variable-centered and person-centered…

Written answers to open-ended questions can have a higher long-term effect on learning than multiple-choice questions. However, it is critical that teachers immediately review the answers, and ask to redo those that are incoherent. This can be a difficult task and can be time-consuming for teachers. A possible solution is to automate the detection…

This paper describes methods and findings from student cognitive labs, teacher cognitive labs, and test administration observations as evidence evaluated in a validity argument for a computer-based alternate assessment for students with significant cognitive disabilities. Validity of score interpretations and uses for alternate assessments based…