National tests, public examinations, and vocational qualifications in England are used for a variety of purposes, including the certification of individual learners in different subject areas and the accountability of individual professionals and institutions. However, there has been ongoing debate about the reliability and validity of their…

We investigated various structural models of phonological processing and the relationship of phonological processing abilities to basic reading. Data were collected on 116 kindergarten and first grade students. The specific ability model, which included phonological awareness, phonological memory, and rapid automatized naming as separate…

Because random assignment is not possible in observational studies, estimates of treatment effects might be biased due to selection on observable and unobservable variables. To strengthen causal inference in longitudinal observational studies of multiple treatments, we present 4 latent growth models for propensity score matched groups, and…

This study used simulation (a) to compare the kernel equating method to traditional equipercentile equating methods under the equivalent-groups (EG) design and the nonequivalent-groups with anchor test (NEAT) design and (b) to apply the parametric bootstrap method for estimating standard errors of equating. A two-parameter logistic item response…

An extensive review of the research literature and a study comparing over 36,000 survey responses with archival true scores indicated that one should expect a minimum of at least three percent random error for the least ambiguous of self-report measures. The Gulliver Effect occurs when a small proportion of error in a sizable subpopulation exerts…

Classical test theory assumes that ability level has no effect on measurement error. Newer test theories, however, argue that the precision of a measurement instrument changes as a function of the examinee's true score. Research has shown that administration errors are common in the Wechsler scales and that subtests requiring subjective scoring…

This technical report provides detailed information regarding the technical, statistical, and measurement attributes of the New York State Testing Program (NYSTP) for the Grades 3-8 Common Core English Language Arts (ELA) and Mathematics 2014 Operational Tests. This report includes information about test content and test development, item (i.e.,…

Notwithstanding criticisms and discussions on methodological grounds, much attention has been and still will be paid to university rankings for various reasons. The present paper uses published information of the 10 top-ranking universities of the world and demonstrates the problem of spurious precision. In view of the problem of measurement error…

This study investigated slope bias on student background variables for both Curriculum Based Measurement of Oral Reading (CBM-R) and Curriculum Based Measurement Maze Reading (Maze). Benchmark scores from 1,738 students in Grades 3 through 8 were used to examine potential slope bias in CBM-R and Maze. Latent growth modeling was used to both…

The focus article by Coburn and Turner (this issue) seeks to provide a comprehensive framework for understanding data use in the context of data-use interventions. This commentary focuses on what the authors see as a glaring omission in what is otherwise a valuable framework: the issue of "useful data." It is their contention that the usefulness…

Our article describing the characteristics of gifted students with a specific learning disability (SLD) in written language was criticized for emphasizing an ability achievement discrepancy as an indication of a written language disability and for not ruling out alternative explanations for the observed difficulties. The three primary alternative…

Walking readers step by step through complex concepts, this book translates missing data techniques into something that applied researchers and graduate students can understand and utilize in their own research. Enders explains the rationale and procedural details for maximum likelihood estimation, Bayesian estimation, multiple imputation, and…

The "Lake Wobegon Effect" (LWE) describes the potential measurement-error bias introduced into survey-based analyses of education issues. Although this effect potentially applies to any student-report variable, the systematic overreporting of academic achievements such as grade point average is often of preeminent concern. This concern can be…

A nonparametric tree classification procedure is used to detect differential item functioning for items that are dichotomously scored. Classification trees are shown to be an alternative procedure to detect differential item functioning other than the use of traditional Mantel-Haenszel and logistic regression analysis. A nonparametric…

Models of modern test theory imply statistical independence among responses, generally referred to as "local independence." One violation of local independence occurs when the response to one item governs the response to a subsequent item. Expanding on a formulation of this kind of violation as a process in the dichotomous Rasch model,…