We are developing the Equitable Screening to Support Youth (ESSY) Whole Child Screener to address concerns prevalent in existing school-based screenings that impede goals to advance educational equity using universal screeners. Traditional assessment development does not include end users in the early development phases, instead relying on a…

We are developing the Equitable Screening to Support Youth (ESSY) Whole Child Screener to address concerns prevalent in existing school-based screenings that impede goals to advance educational equity using universal screeners. Traditional assessment development does not include end users in the early development phases, instead relying on a…

How we choose to use a term depends on what we want to do with it. If "validity" is to be used to support a score interpretation, validation would require an analysis of the plausibility of that interpretation. If validity is to be used to support score uses, validation would require an analysis of the appropriateness of the proposed…

Washback and fairness are interrelated in validity research, and thus an investigation into washback inevitably involves fairness. This article reports Phase One of a washback study of "Test for English Majors for Grade Eight" (TEM8). Phase One was a questionnaire survey administered to university program administrators. Two research…

This response to the comments contains three main sections, each addressing a subset of the comments. In the first section, I will respond to the comments by Brennan, Haertel, and Moss. All of these comments suggest ways in which my presentation could be extended or improved; I generally agree with their suggestions, so my response to their…

Studies of data use illuminate ways in which education professionals have used test scores and other evidence relevant to students' learning--in action in their own contexts of work--to make decisions about their practice. These studies raise instructive challenges for a validity theory that focuses on intended interpretations and uses of test…

This report contains two papers that resulted from the Multilevel Evaluation Systems (MES) Project. The first paper is "Political and Practical Issues in Improving School Boards' Use of Evaluation Data" by Joan Herman. The second paper is "Principals: Their Use of Formal and Informal Data" by Shari Golan and Jeanne Dreyfus. The…

The traditional use of scores derived from standardized, norm-referenced achievement tests is examined as to its role in a local school system's efforts to monitor itself and to examine how well individual students, schools and the overall system are functioning. Several questions regarding the legitimacy of well-established practices involving…

Passing scores for licensure and certification tests are justified by showing that decisions based on the passing score achieve the purposes of the credentialing program while avoiding any serious negative consequences. The passing score is justified to the extent decisions based on it have positive consequences. More specifically, the standard…

This Handbook is intended to help educators understand testing, interpret test results, and defend the selection, construction, and use of tests. The Handbook, tailored to the needs of educators, analyzes only tests used by educators. The Handbook contains more than 100 reviews of tests used routinely to make education decisions and assess skills…

This book is designed to help K-12 teachers and administrators understand the nature of standardized tests and, in particular, the scores that result from them. This useful manual helps teachers develop the skills necessary to incorporate these test scores into various types of instructional decision making--a process known as "data-driven…

An investigation of how some school districts construct and maintain needed links between evaluation/testing and curricular/instructional activities is presented. Researchers must build on the twin strands of research about school and school district organization and developments in testing, evaluation methodology. School district characteristics…

Too few researchers understand what statistical significance testing does and does not do, and consequently their results are misinterpreted. This Digest explains the concept of statistical significance testing and discusses the meaning of probabilities, the concept of statistical significance, arguments against significance testing,…

The increasing use of educational tests to establish the accountability, credibility, and viability of educational programs is paralleled with increasing criticism of the "accountability through testing" philosophy. To analyze the relevancy and appropriateness of tests for educational decision making at the school district level, three…

The use of analyses of achievement test data, particularly longitudinal data, in a wide range of court cases bearing upon educational policy and practice is examined, with an emphasis on assessments of the educational progress of students. The main purpose of the project is to show that assessments of educational progress (i.e., student learning)…