This paper provides some insights into the use of example-generating tasks in the design of a technology-rich learning environment to enhance students' mathematical thinking. The paper reports on an early stage of a design-based research project concerning the design of tasks and associated feedback utilising the affordances provided by a combined…

Remote proctoring, or monitoring test takers through internet-based, video-recording software, has become critical for maintaining test security on high-stakes assessments. The main role of remote proctors is to make judgments about test takers' behaviors and decide whether these behaviors constitute rule violations. Variability in proctor…

Questionnaires are by far the most common tool for measuring noncognitive constructs in psychology and educational sciences. Response bias may pose an additional source of variation between respondents that threatens validity of conclusions drawn from questionnaire data. We present a mixture modeling approach that leverages response time data from…

With the recent and rapid transition to online teaching and learning in higher education, this explanatory study investigated the key design considerations used by business educators designing assessments suitable for online delivery. From a comprehensive literature review, we identified five key design considerations for online assessments: they…

As a result of the COVID-19 pandemic, online assessment has become pivotal to allow evaluation of the knowledge and competences of teachers-to-be. In this context, this study explored language teacher educators' conceptions and practices of online assessment and the implications of this type of assessment for language teacher education. Forty-six…

"Tests of Aptitude for Language Learning" (TALL) is an openly accessible internet-based battery to measure the multifaceted construct of foreign language aptitude, using language domain-specific instruments and L1-sensitive instructions and stimuli. This brief report introduces the components of this theory-informed battery and…

There has been widespread media commentary about the potential impact of generative Artificial Intelligence (AI) such as ChatGPT on the Education field, but little examination at scale of how educators believe teaching and assessment should change as a result of generative AI. This mixed methods study examines the views of educators (n = 318) from…

This study examines the proficiency of Chat GPT, an AI language model, in answering questions on the Situational Judgement Test (SJT), a widely used assessment tool for evaluating the fundamental competencies of medical graduates in the UK. A total of 252 SJT questions from the "Oxford Assess and Progress: Situational Judgement" Test…

The aim of this study was to investigate whether secondary science teachers had different styles of technology adoption for technology-based assessments (TBAs), and whether teachers with different adoption styles showed different patterns of beliefs, attitudes and intentions regarding TBAs. By combining the variable-centered and person-centered…

Written answers to open-ended questions can have a higher long-term effect on learning than multiple-choice questions. However, it is critical that teachers immediately review the answers, and ask to redo those that are incoherent. This can be a difficult task and can be time-consuming for teachers. A possible solution is to automate the detection…

This paper describes methods and findings from student cognitive labs, teacher cognitive labs, and test administration observations as evidence evaluated in a validity argument for a computer-based alternate assessment for students with significant cognitive disabilities. Validity of score interpretations and uses for alternate assessments based…

Technologies that enable individualization for students have significant potential in special education. Computerized Adaptive Testing (CAT) refers to digital assessments that automatically adjust their difficulty level based on students' abilities, allowing for personalized, efficient, and accurate measurement. This article examines whether CAT…

Computational Thinking (CT) skill was a part of the global framework of reference on Digital Literacy for Indicator 4.4.2, widely developed in mathematics and science learning. This study aimed to promote an assessment tool using a two-tier Computerized Adaptive Test (CAT). The study used the Design and Development Research (DDR) method with four…

This meta-analysis examines the influence of smart classrooms on students' learning outcome, synthesizing findings from 21 empirical studies. The results indicate a significant overall effect size (SMD = 1.10), suggesting that smart classrooms positively affect learning outcomes more than traditional settings. Cognitive development (SMD = 1.014)…

Curriculum-based measurement of reading (CBM-R) is a common assessment educators use to monitor student growth in broad reading skills and evaluate the effectiveness of instructional programs. Computer-adaptive tests (CATs), such as Star Reading, have been cited as a viable option to formatively assess reading growth. We used Bayesian…