International Large Scale Assessments have been producing data about educational attainment for over 60 years. More recently however, these assessments as tests have become digitally and computationally complex and increasingly rely on the calculative work performed by algorithms. In this article I first consider the coordination of relations…

Over the past decade, RTI International has pursued the goal of quality, inclusive, differentiated early grade literacy instruction in nearly 30 early grade reading or early grade literacy programs in low- and middle-income (LMI) countries. Across our diverse portfolio, we have supported Ministries of Education (Ministries) in diverse contexts in…

With new state assessments kicking into full swing across the country, schools are seeing more and more parents wanting to opt out their children. Determining whether states allow assessment opt-outs can be complex and is constantly evolving. In some states the answer is clear: State policies either allow or prohibit state assessment opt-outs, or…

Item analysis is essential in improving items which will be used again in later tests; it can also be used to eliminate misleading items in a test. The study focused on item and test quality and explored the relationship between difficulty index (p-value) and discrimination index (DI) with distractor efficiency (DE). The study was conducted among…

Many standardized tests are now administered via computer rather than paper-and-pencil format. The computer-based delivery mode brings with it certain advantages. One advantage is the ability to adapt the difficulty level of the test to the ability level of the test taker in what has been termed computerized adaptive testing (CAT). A second…

Historically, school leaders have occupied a somewhat ambiguous position within networks of power. On the one hand, they appear to be celebrated as what Ball (2003) has termed the "new hero of educational reform"; on the other, they are often "held to account" through those same performative processes and technologies. These…

Accountability has become a primary function of large-scale testing in the United States. The pressure on educators to raise scores is vastly greater than it was several decades ago. Research has shown that high-stakes testing can generate behavioral responses that inflate scores, often severely. I argue that because of these responses, using…

In Shepard's (1997) discussion on the importance of test use and consequences in a validity argument for educational assessments, she reflected on Cronbach and Meehl's (1955) perspective on the role of test developers in providing consequential evidence. In the following year, a special issue in "Educational Measurement: Issues and Practice"…

Lloyd Bond comments here on the Focus article in this issue of "Measurement: Interdisciplinary Research and Perspectives". The Focus article is entitled: "How Task Features Impact Evidence from Assessments Embedded in Simulations and Games" (Russell G. Almond, Yoon Jeon Kim, Gertrudes Velasquez, and Valerie J. Shute). Bond…

Given worldwide prevalence of low-stakes testing for monitoring educational quality and students' progress through school (e.g., Trends in International Mathematics and Science Study, Program for International Student Assessment), interpretability of resulting test scores is of global concern. The nonconsequential nature of low-stakes tests…

Media reports have recently given significant attention to the opt-out movement, an organized effort to refuse to take standardized tests. Although the narrative often told in early press accounts was of a viral grass-roots effort led by parents who object to state-mandated testing, the reality has turned out to be more complicated. Through a…

Haertel's argument is that one must "expand the scope of test validation to include indirect testing effects" because these effects are often the "rationale for the entire testing program." The author strongly agrees that this is essential. However, he maintains that Haertel's argument does not go far enough and that there are two additional…

The PPIC Statewide Survey delivers nonpartisan, objective, advocacy-free information on the perceptions, opinions, and public policy preferences of California residents. PPIC invites input, comments, and suggestions from policy and public opinion experts and from its own advisory committee, but survey methods, questions, and content are determined…

History, when taught properly, and by instructors who are well grounded in the subject matter, is engaging and enlightening. Presently, through insipid curriculum and lack of class time, generations of students are being deprived of a grasp of American history that gives meaning and depth to the concept of citizenship. This article discusses the…

In the context of using tests for educational improvement, Haertel's article--"How Is Testing Supposed to Improve Schooling?"--highlights how the measurement field falls short on validation efforts and demonstrates how by posing the question of how testing is supposed to improve schooling one may start testing different hypotheses about the…