With the 2014 publication of the 5th revision of the "Standards for Educational and Psychological Testing," the cochairs of the Joint Committee for the revision process were asked to consider the role and importance of the "Standards" for the educational testing community, and in particular for members of the National Council…

The authors examined the determinants of success on the Educational Testing Service Major Field Test in Business. The authors find that gender, SAT performance, and concentration are significant predictors of performance. Additionally, they derive proxies for student passion and persistence, and find that the greater the student's passion for…

In this article the author revisits an important book: Brian Simon's "Bending the Rules: the Baker reform of education." Written by a key figure in the history of the journal FORUM as well as in the history of education, Simon's book documented the features of the Education Reform Bill of 1987 (the precursor to the Education Reform Act…

The ability to convey shared meaning with minimal ambiguity is highly desirable for technical terms within disciplines and professions. Unfortunately, there is no widespread professional consensus over the meaning of the word "validity" as it pertains to educational and psychological testing. After illustrating the nature and extent of…

A misconception exists that validity may refer only to the "interpretation" of test scores and not to the "uses" of those scores. The development and evolution of validity theory illustrate test score interpretation was a primary focus in the earliest days of modern testing, and that validating interpretations derived from test…

Michael Kane writes in this article that he is in more or less complete agreement with Professor Koretz's characterization of the problem outlined in the paper published in this issue of "Measurement." Kane agrees that current testing practices are not adequate for test-based accountability (TBA) systems, but he writes that he is far…

In educational testing, differential item functioning (DIF) statistics must be accurately estimated to ensure the appropriate items are flagged for inspection or removal. This study showed how using the Rasch model to estimate DIF may introduce considerable bias in the results when there are large group differences in ability (impact) and the data…

International Large Scale Assessments have been producing data about educational attainment for over 60 years. More recently however, these assessments as tests have become digitally and computationally complex and increasingly rely on the calculative work performed by algorithms. In this article I first consider the coordination of relations…

Over the past decade, RTI International has pursued the goal of quality, inclusive, differentiated early grade literacy instruction in nearly 30 early grade reading or early grade literacy programs in low- and middle-income (LMI) countries. Across our diverse portfolio, we have supported Ministries of Education (Ministries) in diverse contexts in…

With new state assessments kicking into full swing across the country, schools are seeing more and more parents wanting to opt out their children. Determining whether states allow assessment opt-outs can be complex and is constantly evolving. In some states the answer is clear: State policies either allow or prohibit state assessment opt-outs, or…

Item analysis is essential in improving items which will be used again in later tests; it can also be used to eliminate misleading items in a test. The study focused on item and test quality and explored the relationship between difficulty index (p-value) and discrimination index (DI) with distractor efficiency (DE). The study was conducted among…

Accountability has become a primary function of large-scale testing in the United States. The pressure on educators to raise scores is vastly greater than it was several decades ago. Research has shown that high-stakes testing can generate behavioral responses that inflate scores, often severely. I argue that because of these responses, using…

Many standardized tests are now administered via computer rather than paper-and-pencil format. The computer-based delivery mode brings with it certain advantages. One advantage is the ability to adapt the difficulty level of the test to the ability level of the test taker in what has been termed computerized adaptive testing (CAT). A second…

Historically, school leaders have occupied a somewhat ambiguous position within networks of power. On the one hand, they appear to be celebrated as what Ball (2003) has termed the "new hero of educational reform"; on the other, they are often "held to account" through those same performative processes and technologies. These…

In Shepard's (1997) discussion on the importance of test use and consequences in a validity argument for educational assessments, she reflected on Cronbach and Meehl's (1955) perspective on the role of test developers in providing consequential evidence. In the following year, a special issue in "Educational Measurement: Issues and Practice"…