As evidence from evaluation and experimental studies continue to influence decision and policymaking, applied researchers and practitioners require tools to derive valid and credible inferences. Over the past several decades, research in causal inference has progressed with the development and application of propensity scores. Since their…

This study evaluated the feasibility and effectiveness of a low-dose mindfulness program with student-athletes (SA) at a sport academy in the USA. First, SAs were introduced to mindfulness in their health class with conceptual lessons and guided meditations from the Headspace 'Guide to Meditation' series. Following each episode, SAs reflected on…

Although research has explored how in-class pedagogical practices and narrative feedback affect student engagement and motivation, questions remain on the impact of grading systems (i.e. multi-interval grades vs pass/fail and narrative evaluation) on academic motivation. Here, we compared the motivation of students who received multi-interval…

This study examines the hypothesis that having an older sister causes one to perform relatively better at reading. For the analysis, a cross-subject analysis is conducted to examine a student's relative reading test score (reading test score minus math test score) based on older sibling gender. We found that a student's relative reading test score…

Traditional estimators of reliability such as coefficients alpha, theta, omega, and rho (maximal reliability) are prone to give radical underestimates of reliability for the tests common when testing educational achievement. These tests are often structured by widely deviating item difficulties. This is a typical pattern where the traditional…

Purpose: Norm-referenced, standardized measures are tools designed to characterize a child's abilities relative to their same-age peers, but they also have been used to measure changes in skills during intervention. This study compared the psychometric properties of four types of available scores from one commonly used standardized measure, the…

The COVID-19 pandemic caused widespread disruptions to the educational system in Arkansas and across the United States. At the onset of the pandemic in March 2020, schools in Arkansas were forced to replace on-site instruction with virtual instruction. During the 2020-2021 academic year, there were three student instructional options:…

The COVID-19 pandemic has been a seismic and on-going disruption to K-12 schooling. Using test scores from 5.4 million U.S. students in grades 3-8, we tracked changes in math and reading achievement across the first two years of the pandemic. Average fall 2021 math test scores in grades 3-8 were 0.20-27 standard deviations (SDs) lower relative to…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

Test-takers, policymakers, teachers, and institutions are increasingly demanding that testing programs provide more detailed feedback regarding test performance. As a result, there has been a growing interest in the reporting of subscores that potentially provide such detailed feedback. Haberman developed a method based on classical test theory…

This study examines the impact of teacher metapathy, or teachers' capacity to comprehend and sympathize with students' emotional and cognitive requirements, on the academic outcomes of IELTS applicants, such as total band scores, motivation, and language learning orientation. Ten IELTS teachers from five language training centers and 100 IELTS…

This paper reports on a set of three recent experiments utilizing large-scale speech models to assess the oral reading fluency (ORF) of students in Ghana. While ORF is a well-established measure of foundational literacy, assessing it typically requires one-on-one sessions between a student and a trained rater, a process that is time-consuming and…

It is common to find mixed-format data results from the use of both multiple-choice (MC) and constructed-response (CR) questions on assessments. Dealing with these mixed response types involves understanding what the assessment is measuring, and the use of suitable measurement models to estimate latent abilities. Past research in educational…

This study aimed to evaluate the psychometric properties and gather evidence supporting the validity of scores from a traditional Chinese version of the Claremont Purpose Scale (TC-CPS) among Taiwanese adolescents. The TC-CPS, measuring meaningfulness, goal directedness, and beyond-the-self orientation, was administered to 233 high school and 445…

GPT-based models have enabled the creation of natural language chatbots that support both Inquiry-Based and Structured Learning approaches. This study offers a direct comparison of these two paradigms within a UNIX Shell scripting course by means of two chatbots: a Lesson Plan-Driven chatbot that ensures all students cover the same topics…