The ubiquitous use of standardized test results to make varied judgments about educators, students, and schools within the public school system raises concerns of validity. If the test results have not been validated for making multiple determinations, then the decisions made about educators, students, schools, and school districts based on the…

Trying to understand PISA is analogous to the parable of the blind men and the elephant. There are many facets of the PISA program, and thus many ways to both applaud and critique this ambitious international program of assessment that has gained enormous importance in the crafting of contemporary educational policy. One of the facets discussed in…

"Assessing Learning in the Primary Classroom" is an accessible introduction to the concepts critical to a professional understanding of this vital aspect of a teacher's role. It comprehensively considers the principles underpinning effective assessment, the different forms it can take and the different purposes it serves, both within and beyond…

The 2014 Michigan Public High School Context and Performance Report Card is the Mackinac Center's second effort to measure high school performance. The first high school assessment was published in 2012, followed by the Center's 2013 elementary and middle school report card, which used a similar methodology to evaluate school performance. The…

The vast majority of measures have, at their core, a purpose of personal and social change. If test developers and users want measures to have personal and social consequences and impact, then it is critical to consider the consequences and side effects of measurement in the validation process itself. The consequential basis of test interpretation…

The rank-ordering method for standard maintaining was designed for the purpose of mapping a known cut-score (e.g. a grade boundary mark) on one test to an equivalent point on the test score scale of another test, using holistic expert judgements about the quality of exemplars of examinees' work (scripts). It is a novel application of an old…

This evaluation examined school and parent reports of the national student achievement testing system (SIMCE) in Chile regarding three dimensions: access, comprehension, and use. We conducted phone surveys with a representative sample of directors (N = 375), teachers (N = 1145) and parents (N = 625), and we collected more in-depth data through…

The methodology of P. E. Holland and P. R. Rosenbaum (1986) to assess unidimensionality of binary data is outlined and illustrated through a simulation with 36 items for 2,000 examinees. How to interpret the results is discussed. (SLD)

Validity is an integrated evaluative judgment of the degree to which empirical evidence and theoretical rationales support the adequacy and appropriateness of interpretations and actions based on test scores or other modes of assessment. The principles of validity apply not just to interpretive and action inferences derived from test scores as…

A study was conducted to investigate the stability of rater severity over an extended rating period. Multifaceted Rasch analysis was applied to ratings of writing performances of 8,285 primary school (elementary) students. Each performance was rated on two performance dimensions by two trained raters over a period of 7 rating days. Performances…

"Accountability" and "assessment" are terms that are frequently misused and misunderstood. This document is intended to stimulate conversations about assessment of and accountability for student learning, to raise assessment issues that may prevent improved student learning, and raise awareness about the relationship between assessment and…

The purpose of this paper is twofold: to review appropriate assessment techniques in prekindergarten through grade 3 settings and to serve as a catalyst for further discussion and work on the topic of developmentally appropriate accountability assessment. The discussion is based on the thesis that developmentally appropriate assessment and…

The construct validity of content standards is addressed in terms of their representative coverage of a construct domain and their alignment with the students' cognitive level of developing expertise in the subject matter. The construct validity of performance standards is addressed in terms of the extent to which they reflect increasing levels of…

The development of a scoring tool to be used with alternative and authentic assessment strategies is discussed, describing the parts of such a tool and the development process. The design is based on the Innovation Configuration (IC) process of the Concerns-Based Adoption Model. To begin, components of the test task are identified. Variations that…

The realities of inappropriate and sometimes unethical testing practices must be confronted to make sure that current assessments are as reliable and effective as possible. While this paper does not attempt to provide practical guidelines for ethical and appropriate testing, it does draw a picture of appropriate and ethical testing practices. All…