The purpose of this study was to investigate the impact explicit teaching of metacognition had on preservice teachers' metacognitive awareness and accuracy of whole group discussions using virtual simulations. One class of preservice teachers was randomly assigned to the explicit metacognitive teaching group, while the other class was assigned to…

This paper introduces a simple, quotient effect size, termed (for 'quotient'), suitable for reporting on the effectiveness of educational interventions. The quotient effect size for a pre-test-post-test design is defined as the gain score (i.e. post-test minus pre-test) for the intervention group, divided by the gain score for the control group.…

We examined dimensionality and temporal stability of the Interpersonal Stress Scale-Counselor (ISS-C) scores in a sample of professional counselors (n = 518). Confirmatory factor analyses provided support for a four-factor model previously identified through exploratory factor analysis and a bifactor model. Using a randomized test-retest, temporal…

Background: Students with Intellectual Disability undergo frequent cognitive testing. Testing with this population is limited by insensitivity to relative strengths and weaknesses due to floor effects. Aim: The study explored the utility of deviation scores via four case studies as a supplement to educational decision-making. Methods: Four…

The present level of academic achievement and functional performance (PLAAFP) is an essential component of the individualised educational program (IEP) process because it identifies student strengths and areas for growth. However, there is minimal research that examines components of an IEP and student outcomes. The current study examined the…

Assessing students' writing performance is essential to adequately monitor and promote individual writing development, but it is also a challenge. The present research investigates a benchmark rating procedure for assessing texts written by upper-elementary students. In two studies we examined whether a benchmark rating procedure (1) leads to…

Words read correctly per minute (WCPM) is the reporting score metric in oral reading fluency (ORF) assessments, which is popularly utilized as part of curriculum-based measurements to screen at-risk readers and to monitor progress of students who receive interventions. Just like other types of assessments with multiple forms, equating would be…

Longitudinal studies can produce biased estimates of learning if children miss tests. In an application to summer learning, we illustrate how missing test scores can create an illusion of large summer learning gaps when true gaps are close to zero. We demonstrate two methods that reduce bias by exploiting the correlations between missing and…

Oral reading fluency (ORF) assessments are commonly used to screen at-risk readers and to evaluate the effectiveness of interventions as curriculum-based measurements. As with other assessments, equating ORF scores becomes necessary when we want to compare ORF scores from different test forms. Recently, Kara et al. (2023) proposed a model-based…

Engaging in explanation while studying expository science texts can improve comprehension. The present study varied the timing of explanation activities and restudy opportunities before taking final comprehension tests on a set of 6 topics studied as part of a course in Introduction to Psychology. When students had the opportunity to restudy in…

Background: Evidence from education randomized controlled trials (RCTs) in low- and middle-income countries (LMICs) demonstrates how interventions can improve children's educational achievement [1, 2, 3, 4]. RCTs assess the impact of an intervention by comparing outcomes--aggregate test scores--between treatment and control groups. A review of…

Researchers use test outcomes to evaluate the effectiveness of education interventions across numerous randomized controlled trials (RCTs). Aggregate test data--for example, simple measures like the sum of correct responses--are compared across treatment and control groups to determine whether an intervention has had a positive impact on student…

In operational testing, item response theory (IRT) models for dichotomous responses are popular for measuring a single latent construct [theta], such as cognitive ability in a content domain. Estimates of [theta], also called IRT scores or [theta hat], can be computed using estimators based on the likelihood function, such as maximum likelihood…

Purpose: The aim of this study was to assess the effect of eight different facemasks on speech perception and listening effort in listeners with normal hearing (NH) and hearing loss by manipulating both mask type and background noise levels. Method: Forty adults listened to Quick Speech-in-Noise Test sentences recorded by a female talker through…

Coefficient alpha reliability persists as the most common reliability coefficient reported in research. The assumptions for its use are, however, not well-understood. The current paper challenges the commonly used expressions of coefficient alpha and argues that while these expressions are correct when estimating reliability for summed scores,…