For several decades, the "three-parameter logistic model" (3PLM) has been the dominant choice for practitioners in the field of educational measurement for modeling examinees' response data from multiple-choice (MC) items. Past studies, however, have pointed out that the c-parameter of 3PLM should not be interpreted as a guessing…

In the largest study of instructional practice ever undertaken, the Bill & Melinda Gates Foundation's Measures of Effective Teaching (MET) project is searching for tools to save the world from perfunctory teacher evaluations. The first report (released in December 2010) described the potential usefulness of student surveys for providing…

Teacher education has been undergoing significant transformations worldwide in recent decades, and China has made continuous efforts in its quest for world-class teachers. This paper aims at a comprehensive investigation of the complex policy process in China's national initiatives to nurture a world-class teaching force, with qualitative findings…

Validation research for educational achievement tests is often limited to an examination of intended test score interpretations. This article calls for an expansion of validation research in three dimensions. First, validation must attend to actual test use and its consequences, not just score meaning. Second, validation must attend to unintended…

This study examined the "Tejas LEE or El Inventario de Lectura en Espanol de Tejas" (Grade 1) to determine if a relationship existed between reading comprehension in Spanish and the tested skills on the diagnostic assessment. This quantitative research design evaluated the psychometric characteristics of the Tejas LEE and followed customary…

Several researchers (e.g., Klein, Hamilton, McCaffrey, & Stecher, 2000; Koretz & Barron, 1998; Linn, 2000) have asserted that test-based accountability, a crucial component of U.S. education policy, has resulted in score inflation. This inference has relied on comparisons with performance on other tests such as the National Assessment of…

The use of large-scale assessments for making high stakes inferences about students and the schools in which they are situated is premised on the assumption that tests are sensitive to good instruction. An increase in the quality of classroom instruction should cause, on the average, an increase in test scores. In work with a number of colleagues…

The No Child Left Behind Act (2001) increased the federal presence in the test-based accountability movement with its goal of all children meeting standard by 2014. To measure progress toward this goal, each state created a series of intermediate goals. Schools or districts that attained the goal for a given year in 9 different subgroups made…

The use of value-added modeling (VAM) in school accountability is expanding, but deciding how to embrace VAM is difficult. Various experts say it's too unreliable, causes more harm than good, and has a big margin for error. Others assert VAM is imperfect but useful, and provides valuable feedback. A closer look at the models, and their use,…

The 2012 presidential election and many state and local races are only a few weeks away, but schools are not doing much to promote student interest in the elections or provide civic education more broadly, new research suggests. A report last week from the Center for Information and Research on Civic Learning and Engagement (CIRCLE), at Tufts…

The past decade has seen increased testing of students and the concomitant proliferation of computer-based systems to store, manage, analyze, and report the data that comes from these tests. The research to date on teacher use of these data has mostly been qualitative and has mostly focused on the conditions that are necessary (but not necessarily…

The use of value-added modeling (VAM) in school accountability is expanding. However, trying to decide how to embrace VAM can be rather nettlesome. Some experts claim it is "too unreliable," causes "more harm than good," and has "a big margin for error," while other experts assert VAM is "imperfect, but…

Evaluators use their eyes to see what is there, whether it is intended or not. But they use their test instruments to measure what is intended, whether it is there or not. Evaluators have been broadening their repertoire of instruments for years: curriculum-embedded tests, observer checklists, audiotape recorders, videotape recorders, unobtrusive…

Everyone knows what "good" teaching is. Or do they? Although the definition of a good teacher has evolved over time, teachers have consistently been seen as responsible for effecting change. According to the current value-added model, effective teaching is not framed in terms of the specific actions of the teacher, but in terms of students'…

In this technical report, we present the results of a reliability study of the third-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…