Consequential validity (often referred to as "test fairness" in practice) is an essential aspect of educational measurement. This study evaluated the consequential validity of the Research-Based Early Mathematics Assessment (REMA). A sample of 627 children from PreK to second grade was collected using the short form of the REMA. We…

The purpose of this study is to generate non-verbal items for a visual reasoning test using templated-based automatic item generation (AIG). The fundamental research method involved following the three stages of template-based AIG. An item from the 2016 4th-grade entrance exam of the Science and Art Center (known as BILSEM) was chosen as the…

Tests of statistical significance often play a decisive role in establishing the empirical warrant of evidence-based research in education. The results from pattern-based assessment items, as introduced in this paper, are categorical and multimodal and do not immediately support the use of measures of central tendency as typically related to…

The limited availability of research instruments that reflect the vision of the Next Generation Science Standards (NGSS) restricts the field's understanding of whether and how teachers are making instructional shifts called for by the standards. The need for such instruments is particularly urgent with teachers of multilingual learners (MLs), who…

We aimed to identify empirically valid cut scores on the positive behavioral interventions and supports (PBIS) Tiered Fidelity Inventory (TFI) through an expert panel process known as bookmarking. The TFI is a measurement tool to evaluate the fidelity of implementation of PBIS. In the bookmark method, experts reviewed all TFI items and item scores…

Augmented Reality (AR) is increasingly being adopted in education to foster engagement and interest in a variety of subjects and content areas. However, there is a scarcity of instruments to measure the instructional impact of this innovation. This article addresses this gap in two unique ways. First, it presents validation results of the…

In this study, an instrument was developed to measure an instructor's value and incorporation of intersectionality theory in the classroom. Through a Delphi study, a list of items was devised, and then a pilot study was conducted to collect responses from 161 participants. The result is the development of the Intersectionality Pedagogy Scale, a…

Psychometric Properties of the Scale of Positive and Negative Experience (SPANE) have been extensively evaluated in numerous countries, but not in Indonesia. This study investigated factor structure, reliability, measurement invariance, and validity of SPANE scores among a sample of Indonesian university students (N = 405). Multiple measurement…

As learners are able to perceive interactivity when interacting with instructors or peer learners in traditional learning environments, learners are similarly able to perceive interactivity when interacting with artificial intelligence (AI) in AI-supported learning environments. Advancements in AI, such as generative AI including ChatGPT and…

Children with developmental disabilities have different feeding and swallowing problems. The purposes of the present study were to develop an Arabic version of the FHI-C and to evaluate its validity, consistency, and reliability in Arabic children with developmental disabilities for assessing how feeding and swallowing problems impair the…

This study explores the implementation of Differentiated Instruction (DI) in Philippine multigrade classrooms and develops a tool to assess teacher proficiency in DI. Employing an exploratory sequential mixed-method design, the qualitative phase included focus group discussions with eight multigrade teachers, capturing their experiences and…

Bayesian Knowledge Tracing (BKT) is a well-established model for formative assessment, with optimization typically using expectation maximization, conjugate gradient descent, or brute force search. However, one of the flaws of existing optimization techniques for BKT models is convergence to undesirable local minima that negatively impact…

The ability to draw visual representations such as diagrams and graphs is considered fundamental to science learning. Science exams therefore often include questions which require students to draw a visual representation, or to augment a partially provided one. The design features of such questions (e.g., layout of diagrams, amount of answer…

Purpose: Assessing social communication and measuring its changes among young autistic children presents significant challenges, particularly when tracking intervention effects within short timeframes. Existing measures, mostly validated in Western contexts, may not be suitable for culturally diverse populations. Addressing this gap, the Social…

This study explored the effectiveness of extended time (ET) accommodations in the 2017 NAEP Grade 8 Mathematics assessment to enhance educational equity. Analyzing NAEP process data through an XGBoost model, we examined if early interactions with assessment items could predict students' likelihood of requiring ET by identifying those who received…