For many practical purposes, it is often assumed that the quality of a marker is directly related to their seniority. At its extreme, the assumption is that the most senior marker (the Principal Examiner) is always right even in cases where large numbers of junior markers have a collectively different opinion regarding the mark that should be…

Purpose: We investigated the finite verb morphology composite (FVMC), a measure associated with developmental language disorder (DLD), in a large community sample to provide evidence on its distribution, its association with other variables, and its sensitivity and specificity. Method: We coded percent occurrence of FVMC morphemes in obligatory…

In institution research, surveys of students or faculty can be a helpful tool to gather data. Surveying a sample of students or faculty and computing weights to be able to make inferences to your student or faculty population are important. In this chapter, we introduce the connected topics of sampling and weighting. We begin with a discussion on…

The "Standards for Educational and Psychological Testing" recommend an argument-based approach to validation that involves a clear statement of the intended interpretation and use of test scores, the identification of the underlying assumptions and inferences in that statement--termed the interpretation/use argument, and gathering of…

Background: Community participation is considered a fundamental aspect of quality of life and one of the essential goals of services for people with intellectual disabilities, yet there is no agreed way of measuring community participation. Method: Two systematic searches were performed across eight electronic databases to identify measures of…

This article explores the amount of equating error at a passing score when equating scores from exams with small samples sizes. This article focuses on equating using classical test theory methods of Tucker linear, Levine linear, frequency estimation, and chained equipercentile equating. Both simulation and real data studies were used in the…

Differential Item Functioning (DIF) detection procedures provide validity evidence for proposed interpretations of test scores that can help researchers and practitioners ensure that test scores are free from potential bias, and that individual items do not create an advantage for any subgroup of examinees over another. In this study, we use the…

This note discusses the merits of coefficient alpha and their conditions in light of recent critical publications that miss out on significant research findings over the past several decades. That earlier research has demonstrated the empirical relevance and utility of coefficient alpha under certain empirical circumstances. The article highlights…

The purpose of this study is to investigate whether factor scores can be used instead of ability estimation and total score. For this purpose, the relationships among total score, ability estimation, and factor scores were investigated. In the research, Turkish subtest data from the Transition from Primary to Secondary Education (TEOG) exam…

Diesel emissions from school buses expose children to high levels of air pollution; retrofitting bus engines can substantially reduce this exposure. Using variation from 2,656 retrofits across Georgia, we estimate effects of emissions reductions on district-level health and academic achievement. We demonstrate positive effects on respiratory…

Reliability is the consistency of a set of scores that are designed to measure the same thing. Reliability is a statistical property of scores that must be demonstrated rather than assumed.

According to Wollack and Schoenig (2018), score differencing is one of six types of statistical methods used to detect test fraud. In this paper, we suggested the use of Bayes factors (e.g., Kass & Raftery, 1995) for score differencing. A simulation study shows that the suggested approach performs slightly better than an existing frequentist…

Background/Context: Regression discontinuity (RD) designs are used for policy and program evaluation where subjects' eligibility into a program or policy is determined by whether an assignment variable (i.e., running variable) exceeds a pre-defined cutoff. Under a standard RD design with a continuous assignment variable, the average treatment…

Test-optional admissions policies have been steadily, though slowly, expanding throughout higher education institutions for decades. The COVID-19 pandemic, however, sparked a rapid expansion of institutions adopting test-optional policy. Using a diffusion of innovations framework, this study assesses the institutional characteristics that shaped…

Background: As delays or disorders in early language and communication are the most prevalent symptom in children with disabilities, early screening is crucial to promote prevention, early diagnosis, and intervention. However, to the best of our knowledge, no screening tool is available for the joint assessment of early language and social…