Validity is a fundamental consideration of test development and test evaluation. The purpose of this study is to define and reify three key aspects of validity and validation, namely test-score interpretation, test-score use, and the claims supporting interpretation and use. This study employed a Delphi methodology to explore how experts in…

Researchers have documented the impact of rater effects, or raters' tendencies to give different ratings than would be expected given examinee achievement levels, in performance assessments. However, the degree to which rater effects influence person fit, or the reasonableness of test-takers' achievement estimates given their response patterns,…

Many scholars compared various item discrimination indices in real or simulated data. Item discrimination indices, such as item-total correlation, item-rest correlation, and IRT item discrimination parameter, provide information about individual differences among all participants. However, there are tests that aim to select a very limited number…

Rater training is an important part of developing and conducting large-scale constructed-response assessments. As part of this process, candidate raters have to pass a certification test to confirm that they are able to score consistently and accurately before they begin scoring operationally. Moreover, many assessment programs require raters to…

The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices,…

Implications of the multiple-use of accountability assessments for the process of validation are examined. Multiple-use refers to the simultaneous use of results from a single administration of an assessment for its intended use and for one or more additional uses. A theoretical discussion of the issues for validation which emerge from…

This article describes how three Utah school districts employed tests, specifically National Teacher Examinations, as one line of optional evidence for use (along with a selection of other evidence) in the promotion of eligible teachers. (Author/LMO)

The National Association of Test Directors (NATD) conducted a survey of testing issues and practices in members' public school districts in the United States during the 1988-89 school year. Responses from 50 testing directors in large school districts as summarized provide an overview of test use and testing practices. (SLD)

Content areas that should be included in testing and measurement courses, subsidiary skills, and means of rationalizing the content and skills are outlined. Areas include basic concepts, assessment uses, assessment planning and development, interpretation of assessments, description of results, evaluation and improvement of assessments, feedback…

A sample (N=37) of currently published achievement tests was surveyed as to the availability of five types of technical data: (1) item selection techniques; (2) standardization; (3) types of norms; (4) types of validating data; and (5) types of reliability data. Recommendations for publishers and cautions for test users are given. (BS)

Elementary and secondary teachers (N=323) were surveyed to determine teacher use of post hoc classroom test statistics and the relationship of inservice practices to background and instructional characteristics. Results indicate teachers do not analyze test results by methods prescribed by measurement specialists. Implications for preservice…

Effects of standardized testing on teaching and learning were studied in a survey of 341 elementary school teachers in 9 states, focusing on the meaning of test scores and test-score gains. Results indicate that standardized testing has considerable effects, and that teachers feel considerable pressure to improve student scores. (SLD)

Cognitive psychologists and measurement specialists have identified several methods for assessing students' knowledge structures. Applications of the Concept Structure Analysis Technique and MicroCAM (a computer-aided method) are described. Other research into schema knowledge is noted. These assessment procedures provide information about student…

Problematic opinions and practices regarding testing and grading were studied for 536 secondary school teachers of academic subjects. Results indicate widespread differences between teacher beliefs and practices and what measurement specialists would recommend as testing practices. Implications for teacher training in measurement are discussed.…

A survey of 2,256 teachers, testing coordinators, principals, and superintendents on ethical issues related to norm-referenced test (NRT) administration and practice found that 44 percent believed that colleagues engage in practices that are blatant cheating, and 78 percent believed that teaching information only because it is on the test occurs.…