Kane's paper "Validating the Interpretations and Uses of Test Scores" is the most complete and clearest discussion yet available of the argument-based approach to validation. At its most basic level, validation as formulated by Kane is fundamentally a simply-stated two-step enterprise: (1) specify the claims inherent in a particular interpretation…

This technical report provides detailed information regarding the technical, statistical, and measurement attributes of the New York State Testing Program (NYSTP) for the Grades 3-8 English Language Arts (ELA) and Mathematics 2018 Operational Tests. This report includes information about test content and test development, item (i.e., individual…

This technical report provides detailed information regarding the technical, statistical, and measurement attributes of the New York State Testing Program (NYSTP) for the Grades 3-8 English Language Arts (ELA) and Mathematics 2017 Operational Tests. This report includes information about test content and test development, item (i.e., individual…

Testing and data integrity on statewide assessments is defined as the establishment of a comprehensive set of policies and procedures for: (1) the proper preparation of students; (2) the management and administration of the test(s) that will lead to accurate and appropriate reporting of assessment results; and (3) maintaining the security of…

The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…

Normal Curve Equivalents (NCEs), a new score system for standardized tests, are used by school districts in reporting results to federal funding agencies. The author uses a quiz format to answer questions on the use of NCE scores. (EGS)

The booklet was designed to help each recipient of the California Achievement Test (CAT) reports to understand the general format of the reports, the abbreviations and symbols used, and the types of scores presented. It was also intended to assist in interpreting CAT results and using these results at each level of the educational process to best…

This paper presents a method for estimating the accuracy and consistency of classifications based on test scores. The scores can be produced by any scoring method, including the formation of a weighted composite. The estimates use data from a single form. The reliability of the score is used to estimate its effective test length in terms of…

Most human gradings of essays are holistic, or "overall." Therefore, Project Essay Grade (PEG), an attempt to develop computerized grading of essays, has concentrated most of its research on overall grading. It has successfully simulated human judges. However, since computer grading is less expensive than human grading, PEG has also…

Valid interpretation of test scores is the shared responsibility of the test designer and the test user. Test publishers must provide evidence of the validity of the decisions their tests are intended to support, while test users are responsible for analyzing this evidence and subsequently using the test in the manner indicated by the publisher.…

Incidents affecting the implementation of large-scale testing programs are described to illustrate associated problems. Issues addressed include creation of test materials, preparation of answer documents, transportation of test materials, scoring and analysis of tests, and dissemination and utilization of test results. (TJH)

Beginning in 1999, all of the Pennsylvania System of School Assessment (PSSA) had to be aligned with the Pennsylvania Academic Standards. This handbook describes the PSSA mathematics assessment. Following an overview of the PSSA, the second chapter focuses on the development and scoring of the mathematics assessment. Administering the assessment…

Beginning in 1999, all of the Pennsylvania System of School Assessment (PSSA) had to be aligned with the Pennsylvania Academic Standards. This handbook describes the PSSA writing assessment, which was designed to measure individual student performance and to influence instruction. The guide contains a chart of the Pennsylvania Academic Standards…

This technical report describes the development of the College-Level Academic Skills Test (CLAST), an instrument designed to measure Florida college students' achievement of the computation and communication skills expected by the completion of their sophomore year. Section I covers CLAST's background and purpose, the requirement that all students…

Beginning in 1999, all of the Pennsylvania System of School Assessment (PSSA) had to be aligned with the Pennsylvania Academic Standards. This handbook describes the PSSA reading assessment. It contains samples and instructions for developing assessment items for grades 5, 8, and 11. Although designed for teachers, the Handbook is meant to be a…