In this work we examined the content of approximately 950 mathematics questions used in measuring achievement among 4th, 5th and 6th graders in the US in an attempt to determine how the current standardized examinations, which were developed to reflect new national curricular mandates, compared to the old measures used for the same purpose. Using…

A recent NBER [National Bureau of Economic Research] working paper examines Florida's policy to retain many low-scoring third graders. The report concludes that third-grade retention has immediate positive effects on the following year's test results, but these effects fade over the next six years, with no effect on graduation. The regression…

In response to the dramatic rise in childhood obesity, the Centers for Disease Control (CDC) and other organizations have advocated increasing the time that elementary school children spend in physical education (PE) classes. However, little is known about the effect of PE on child weight. This paper measures that effect by instrumenting for child…

The grades K-2 Florida Center for Reading Research (FCRR) Reading Assessment (FRA) consists of computer-adaptive alphabetic and oral language screening tasks that provide a Probability of Literacy Success (PLS) linked to grade-level performance (i.e., the 40th percentile) on the word reading (in kindergarten) or reading comprehension (in grades…

In this article we propose several modeling choices to extend propensity score analysis to clustered data. We describe different possible model specifications for estimation of the propensity score: single-level model, fixed effects model, and two random effects models. We also consider both conditioning within clusters and conditioning across…

The Brief Academic Competence Evaluation Screening System (BACESS) is a multiphase universal screening measure designed to assist educators in the identification of students who are likely to experience learning difficulties in elementary school. This study evaluated the reliability and validity of the measure for this purpose. The BACESS was used…

Item response theory (IRT) is based on the assumption that a direct relationship exists between an examinee's total performance on a set of items and the difficulty of each item on the test. The Rasch model represents this relationship mathematically on an equal interval scale. This paper argues that IRT, under the required conditions, provides…

Two fundamental problems in mental test theory are to estimate true score and to estimate the amount of error when testing an examinee. In this report, three probability models which characterize a single test item in terms of a population of examinees are described. How these models may be modified to characterize a single examinee in terms of an…

This book shows the advantages of Rasch measurement (G. Rasch) for school district testing programs. The results of Rasch methods are contrasted with conventional statistics for assessing student responses to basic skills testing. Chapter 1 shows how the Rasch probability-based method produces measures that are more useful for students, parents,…

Some standard-setting methods require judges to estimate the probability that an examinee who just meets an achievement standard will answer each of a set of items correctly. These probability estimates are then used to infer the values on some latent scale that, in theory, determines an examinee's responses. The paper focuses on the procedures…