Quantitative measures of systematic differences in OSCE scoring across examiners (often termed examiner stringency) can threaten the validity of examination outcomes. Such effects are usually conceptualised and operationalised based solely on checklist/domain scores in a station, and global grades are not often used in this type of analysis. In…

Institutions of higher education have relied heavily on quality assurance mechanisms such as accreditation to ensure programs adhere to the most current standards. Simultaneously, conversations alluding to the impact of organizational culture have also increased, leaving many to question if relationships exist between educational environments,…

As evidence from evaluation and experimental studies continue to influence decision and policymaking, applied researchers and practitioners require tools to derive valid and credible inferences. Over the past several decades, research in causal inference has progressed with the development and application of propensity scores. Since their…

The study was proposed to find out the effect of frequent testing on students' academic achievement at undergraduate level. In this study, quasi-experimental pretest post-test control group design was used. Two intact groups, control (28) and experimental (51) were selected that were undergone a Research Methods course at undergraduate level. Two…

Latent profile analysis (LPA) identifies heterogeneous subgroups based on continuous indicators that represent different dimensions. It is a common practice to measure each dimension using items, create composite or factor scores for each dimension, and use these scores as indicators of profiles in LPA. In this case, measurement models for…

This study evaluated the feasibility and effectiveness of a low-dose mindfulness program with student-athletes (SA) at a sport academy in the USA. First, SAs were introduced to mindfulness in their health class with conceptual lessons and guided meditations from the Headspace 'Guide to Meditation' series. Following each episode, SAs reflected on…

Although research has explored how in-class pedagogical practices and narrative feedback affect student engagement and motivation, questions remain on the impact of grading systems (i.e. multi-interval grades vs pass/fail and narrative evaluation) on academic motivation. Here, we compared the motivation of students who received multi-interval…

This study examines the hypothesis that having an older sister causes one to perform relatively better at reading. For the analysis, a cross-subject analysis is conducted to examine a student's relative reading test score (reading test score minus math test score) based on older sibling gender. We found that a student's relative reading test score…

Traditional estimators of reliability such as coefficients alpha, theta, omega, and rho (maximal reliability) are prone to give radical underestimates of reliability for the tests common when testing educational achievement. These tests are often structured by widely deviating item difficulties. This is a typical pattern where the traditional…

A theoretical and conceptual framework for true-score equating using a simple-structure multidimensional item response theory (SS-MIRT) model is developed. A true-score equating method, referred to as the SS-MIRT true-score equating (SMT) procedure, also is developed. SS-MIRT has several advantages over other complex multidimensional item response…

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists…

Purpose: Norm-referenced, standardized measures are tools designed to characterize a child's abilities relative to their same-age peers, but they also have been used to measure changes in skills during intervention. This study compared the psychometric properties of four types of available scores from one commonly used standardized measure, the…

The COVID-19 pandemic caused widespread disruptions to the educational system in Arkansas and across the United States. At the onset of the pandemic in March 2020, schools in Arkansas were forced to replace on-site instruction with virtual instruction. During the 2020-2021 academic year, there were three student instructional options:…

The COVID-19 pandemic has been a seismic and on-going disruption to K-12 schooling. Using test scores from 5.4 million U.S. students in grades 3-8, we tracked changes in math and reading achievement across the first two years of the pandemic. Average fall 2021 math test scores in grades 3-8 were 0.20-27 standard deviations (SDs) lower relative to…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…