Much of the argument about comparability of examination standards is at cross-purposes; contradictory positions are in fact often both defensible, but they are using the same words to mean different things. To clarify this, two broad conceptualisations of standards can be identified. One sees the standard in the observed phenomena of performance…

The rank-ordering method for standard maintaining was designed for the purpose of mapping a known cut-score (e.g. a grade boundary mark) on one test to an equivalent point on the test score scale of another test, using holistic expert judgements about the quality of exemplars of examinees' work (scripts). It is a novel application of an old…

Robert Coe has claimed that three broad conceptions of comparability can be identified from the literature: performance, statistical and conventional. Each of these he rejected, in favour of a single, integrated conception which relies upon the notion of a "linking construct" and which he termed "construct comparability".…

Newton's article (2010) makes three main contributions to the literature. First, it is transatlantic, bringing together literatures that have been dealing with similar problems, using sometimes different methods and certainly with distinctive educational, cultural perspectives. He points out that neither of these literatures has all of the…

In today's educational setting, assessment results weigh heavily in determining what students should know and be able to do. In addition, because assessment scores are often tied to accountability systems that affect both teaching and learning, they influence what is taught in the classroom. The changes in the use of assessments underscore the…

Reviews the 1974 Standards, an updating serving as a guide to test making and publishing, and training of persons for these endeavors. (DEP)

This paper reports the results of a survey conducted in the spring of l981 that was designed to collect and summarize guidelines on appropriate test use from the various organizations, agencies, and associations involved in standardized educational testing. The primary objective of the study was to learn how these various groups define the issues…

Several issues are related to the use of educational tests. First, test users must be able to choose appropriate tests, interpret scores, and make decisions based on scores. In the field of educational testing, few test users have adequate training in these areas. Second, test makers must clearly specify directions for administration, allowable…

With the intent of spurring discussion and raising important issues about the topic of test standards, this circular serves primarily as a resource document for member organizations of the National Consortium on Testing (NCT). Additionally, it identifies the broad changes which have evolved since 1953 regarding ethical and technical standards for…

Examines the appropriateness of a cut-off score derived from the Angoff procedure for a reading test in the United Kingdom. Shows that the recommended cut-off score is too low. Suggests ways that standard setting might draw on a range of information to produce appropriate and rationally defensible cut-off scores. (DSK)

This monograph serves as a nontechnical guide to teachers, counselors, school psychologists, administrators, parents, and others who use the 1974 Standards for Educational and Psychological Tests. The Standards are a concise summary of standards and guidelines for the development, evaluation, interpretation, use, and reporting of information on…

The purpose of this digest is to describe school counselors' roles in the area of assessment through an historical review of testing in counseling, and to report on study findings regarding roles employers require school counselors to perform. Knowledge needed by counselors to obtain evidence, evaluate its usefulness, and interpret its meaning…

The proposed standard for judging proficiency test score reliability requires that the proportion of items passed for each objective assessed be a dependable estimate of the universe score for the domain strata established by the objective. Domain breadth is the focusing issue. Data from a field trial of the Tennessee Proficiency Test are analyzed…

A strong stand against the use of College Entrance Examination Board (CEEB) scores to evaluate high school language programs is developed in this position paper. Equally criticized is the practice of teacher evaluation based on analysis of student achievement as reflected in the scores. The mystery of determining the significance of percentile…

Discusses which kinds of data educators should respect and which they should reject. Asserts that most state accountability tests fail to produce the kinds of data that will improve teaching and learning. Teachers can get the data they need from their own instructionally useful classroom assessments. (WFA)