Daniel Koretz is the Henry Lee Shattuck Professor of Education at the Harvard Graduate School of Education. His research focuses on educational assessment and policy, particularly the effects of high-stakes testing on educational practice and the validity of score gains. He is the author of "Measuring Up: What Educational Testing Really Tells…

This study constitutes the secondary analysis of data collected as part of classroom instruction in a prior practitioner inquiry study. Consequently, IRB approval, parental consent, and participant assent for the present study were obtained after the conclusion of the original study.

This study examined how much improvement was attainable with respect to accuracy of differential item functioning (DIF) measures and DIF detection rates in the Mantel-Haenszel procedure when employing focal and reference groups with notably unbalanced sample sizes where the focal group has a fixed small sample which does not satisfy the minimum…

A total of 19 graduate students enrolled in a graduate course conducted 6 consecutive administrations of the Wechsler Intelligence Scale for Children, 4th edition (WISC-IV, Canadian version). Test protocols were examined to obtain data describing the frequency of examiner errors, including administration and scoring errors. Results identified 511…

The 2011 NAEP-TIMSS linking study conducted by the National Center for Education Statistics (NCES) was designed to predict Trends in International Mathematics and Science Study (TIMSS) scores for the U.S. states that participated in 2011 National Assessment of Educational Progress (NAEP) mathematics and science assessment of eighth-grade students.…

This paper examines factors that influence the post-adoption satisfaction of educators with e-learning systems. Based on the expectation-confirmation framework, we propose a research model that demonstrates how post-adoption beliefs affect post-adoption satisfaction. The model was tested at a university by educators (n = 175) who use an e-learning…

This report examines the differences in impact estimates and standard errors that arise when these are derived using state achievement tests only (as pre-tests and post-tests), study-administered tests only, or some combination of state- and study-administered tests. State tests may yield different evaluation results relative to a test that is…

The No Child Left Behind Act (NCLB) permits the Secretary of Education to use NAEP achievement level scores, in concert with other data, to confirm state testing results. The U.S. Department of Education has not yet published a guidance document describing how NAEP might be used appropriately. A review of the literature from the Department and…

Large sample standard errors for the Tucker method of linear equating under the common item nonrandom groups design are derived under normality assumptions as well as under less restrictive assumptions. Standard errors of Tucker equating are estimated using the bootstrap method described by Efron. The results from different methods are compared…

The present paper describes an attempt to establish a paper and pencil test battery for improving predictive efficiency in the selection of supporting services personnel at Montgomery County Public Schools and a report on the validation of such a procedure. (Author)

This work presents a methodological critique and secondary analysis of a large scale societal experiment, performed by Kellaghan, that studied the educational and psychological effects of the introduction of standardized achievement/ability testing in elementary schools in Ireland. (Author/PN)

Despite its widespread use in evaluation data analysis, statistical testing has come under persistent criticism resulting in calls for its rethinking, and even possible elimination (Carver, 1978, 1993). Saxon and Boylan issue a call "to strengthen developmental education research and to make it more accessible" (2003, p. 2). Among the types of…

To evaluate test speededness and to derive implications for test program activity, this study reviewed the literature on speed and power, identifying four major approaches to the assessment of speed: the Gulliksen approach, the Cronbach and Warrington approach, the Stafford approach, and the approach of the Educational Testing Service (ETS) as…

This study is designed to investigate the effect of personality factors on management effectiveness. (Author)

The utility of modified item response theory (IRT) models in small sample testing applications was studied. The modified IRT models were modifications of the one- and two-parameter logistic models. One-, two-, and three-parameter models were also studied. Test data were from 4 years of a national certification examination for persons desiring…