Traditional estimators of reliability such as coefficients alpha, theta, omega, and rho (maximal reliability) are prone to give radical underestimates of reliability for the tests common when testing educational achievement. These tests are often structured by widely deviating item difficulties. This is a typical pattern where the traditional…

A theoretical and conceptual framework for true-score equating using a simple-structure multidimensional item response theory (SS-MIRT) model is developed. A true-score equating method, referred to as the SS-MIRT true-score equating (SMT) procedure, also is developed. SS-MIRT has several advantages over other complex multidimensional item response…

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists…

Purpose: Norm-referenced, standardized measures are tools designed to characterize a child's abilities relative to their same-age peers, but they also have been used to measure changes in skills during intervention. This study compared the psychometric properties of four types of available scores from one commonly used standardized measure, the…

The COVID-19 pandemic caused widespread disruptions to the educational system in Arkansas and across the United States. At the onset of the pandemic in March 2020, schools in Arkansas were forced to replace on-site instruction with virtual instruction. During the 2020-2021 academic year, there were three student instructional options:…

The COVID-19 pandemic has been a seismic and on-going disruption to K-12 schooling. Using test scores from 5.4 million U.S. students in grades 3-8, we tracked changes in math and reading achievement across the first two years of the pandemic. Average fall 2021 math test scores in grades 3-8 were 0.20-27 standard deviations (SDs) lower relative to…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

Purpose: With the current study, we aimed to reveal the similarities and differences in sensory profiles between Williams syndrome (WS) and autism spectrum disorder. Methods: Using the sensory profile questionnaire completed by the caregivers, we analyzed the WS (n = 60, 3.4-19.8 years) and autistic (n = 39, 4.2-14.0 years) groups. Results: The…

Background: Current clinical approaches to the treatment of spoken word-finding difficulties in acquired aphasia encourage multimodal cueing, especially the joint application of written and spoken forms. Research that exclusively examines the effects and mechanisms of written cues is limited, with most studies engaging written forms only as part…

This research article establishes the relationship between key performance indicators and the academic and research quality performance and assessment and quality assurance of any large multidisciplinary academic and research institution or university. The indicators in terms of qualitative and quantitative are being proposed below and are…

This study aimed to develop a comprehensive diagnostic tool for assessing upper-secondary school students' understanding of isomers, expanding upon existing two- and three-tier conceptual diagnostic methods. By incorporating 'Confidence Rating Factor' tiers within the answer and reason sections, a four-tier test was designed and developed. This…

This study examines the impact of teacher metapathy, or teachers' capacity to comprehend and sympathize with students' emotional and cognitive requirements, on the academic outcomes of IELTS applicants, such as total band scores, motivation, and language learning orientation. Ten IELTS teachers from five language training centers and 100 IELTS…

This paper reports on a set of three recent experiments utilizing large-scale speech models to assess the oral reading fluency (ORF) of students in Ghana. While ORF is a well-established measure of foundational literacy, assessing it typically requires one-on-one sessions between a student and a trained rater, a process that is time-consuming and…

Test-takers, policymakers, teachers, and institutions are increasingly demanding that testing programs provide more detailed feedback regarding test performance. As a result, there has been a growing interest in the reporting of subscores that potentially provide such detailed feedback. Haberman developed a method based on classical test theory…

It is common to find mixed-format data results from the use of both multiple-choice (MC) and constructed-response (CR) questions on assessments. Dealing with these mixed response types involves understanding what the assessment is measuring, and the use of suitable measurement models to estimate latent abilities. Past research in educational…