Assessment and evaluation tools and instruments are developed to measure many things from content knowledge to misconceptions to student affect. The standard validation processes for these are regularly conducted and provide strong evidence for the validity of the measurements that are made. As part of the suite of validation tools available to…

Science concepts, like electromagnetism, involve abstract relations, which are often problematic in students' learning. Electromagnetism concepts are crosscutting concepts across science disciplines. Astandardized Conceptual Survey of Electricity and Magnetism, which is a 32-item multiple-choice test, was used to collect data from 117 first-year…

Two-stage collaborative testing is an assessment strategy that involves students initially writing a test individually and then immediately afterward writing the same (or similar) test again in groups. Current evidence shows that two-stage testing improves performance on multiple-choice tests as well as short-term retention of material, but little…

Multiple-choice (MC) exams are common in undergraduate general chemistry courses in the United States and are known for being difficult to construct. With their extensive use in the general chemistry classroom, it is important to ensure that these exams are valid measures of what chemistry students know and can do. One threat to MC exam validity…

Examinees' performances are assessed using a wide variety of different techniques. Multiple-choice (MC) tests are among the most frequently used ones. Nearly, all standardized achievement tests make use of MC test items and there is a variety of ways to score these tests. The study compares number right and liberal scoring (SAC) methods. Mixed…

We examined the effect of two methods of assessment--multiple-choice sentence-picture matching and an animated sentence-verification task--on typically developing children's understanding of relative clauses. A sample of children between the ages of 3 years 6 months and 4 years 11 months took part in the study (N = 103). Results indicated that (a)…

This study is an exploratory analysis of examinee behavior in a large-scale language proficiency test. Despite a number-right scoring system with no penalty for guessing, we found that 16% of examinees omitted at least one answer and that women were more likely than men to omit answers. Item-response theory analyses treating the omitted responses…

This paper describes an experience based on the use of an active method in which students of a basic physics course prepare multiple choice questions (MCQs) to prepare for exams in the subject. The objective of the research was to provide the students with a method that would enhance their desire to learn physics, and consequently lead to an…

Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting…

The use of concurrent data elicitation procedures (e.g. think-alouds, eye-tracking, response time) to investigate learners' cognitive processing and processes is becoming more prominent in research designs as researchers seek to acquire a better understanding of how second language (L2) learners process L2 data (e.g. Martin et al., 2019; Rogers,…

The current study investigated the impact of manipulating reading strategy, reading the questions first (QF) or the passage first (PF), during a reading comprehension test, and we explored how reading strategy was related to student characteristics. Participants' eye movements were monitored as they read 12 passages and answered multiple-choice…

Nowadays, Malaysian ESL students struggle to read English texts, particularly narrative texts. Lacking in utilising and applying the suitable reading strategies are among factors that hinder reading comprehension. This study aimed to investigate the effectiveness of Question-Answer Relationship (QAR) strategy on ESL pupils' narrative reading and…

Large language models (LLMs)-based chatbots use natural language processing and are a type of generative artificial intelligence (AI) that is capable of comprehending user input and generating output in various formats. They offer potential benefits in medical education. This study explored the student's feedback on the utilization of LLMs in…

Playback controls or audio/video control (AVC) buttons are common in technology-enhanced listening materials but are often overlooked in CALL theorizing and research. It is unclear how language learners use AVC buttons when they independently access computer-based L2 listening materials. This qualitative case study aimed to understand how…

Causal reasoning is important to children's cognition and academic development. However, there have been few empirical studies on the impact of visual cues and non-verbal scaffolding on children's reasoning in continuous causal processes. Hence, the present study aims to explore how causal reasoning in continuous processes is facilitated by visual…