This paper follows a line of logical argumentation to claim that what Samuel Messick conceptualized about construct validation has probably been misunderstood by some educational policy makers, practicing educators, and classroom teachers. It argues that, while Messick's unified theory of test validation aimed at (a) warning educational…

Forty-six tests from the Kit of Factor-Referenced Cognitive Tests, published by the Educational Testing Service, were used in an investigation of the factor structure of the Armed Services Vocational Aptitude Battery. The overall kit contains 72 fairly short tests that have been developed to serve as markers for 23 factors that appear in the…

Confusion in the terminology used in criterion-referenced measurement specifications and development and standard setting and the attendant role of cut-off scores are shown to need practical clarification through psychometric research on test applications and consequences. (CM)

Discusses problems with the ACTFL/ETS Oral Proficiency Guidelines and examines inconsistencies relating to three assumptions of oral proficiency (OPT)--hours of study, accuracy/interest, and errors. Further, it is argued that the main problems with OPT arise from an analytic approach and the native speaker yardstick. (SED)

Instructional programs organized according to modern educational technology are discussed within the purposes of criterion-referenced measurements used. The problems of criterion-referenced measurements include scoring and score interpretation, item and test analysis, and mastery testing. An overview of solutions and approaches to the problems and…

Research evidence relating to the utility of the RMC evaluation models of compensatory education employing non-normed tests is examined. The history and evolution of five early models into the current norm-referenced model utilizing a non-normed test (Model A2), non-normed versions of a comparison model (Model B2), and the regression model (Model…

Some unfinished issues relating to achievement test theory that seemed implicit in the basic idea of criterion-referenced testing are reviewed, recognizing their importance in current studies of authentic assessment and performance-based tests. The future of performance-based evaluation is explored. (SLD)

This guide explains the benefits of and procedures for constructing and administering criterion-referenced performance tests in vocational education programs. Addressed in the individual sections are the following topics: the rationale for using task performance measures in vocational education; the predictive validity and physical fidelity of…

A sample (N=37) of currently published achievement tests was surveyed as to the availability of five types of technical data: (1) item selection techniques; (2) standardization; (3) types of norms; (4) types of validating data; and (5) types of reliability data. Recommendations for publishers and cautions for test users are given. (BS)

The nature and quality of teacher-developed tests was studied in a national sample of 228 teachers representing four grade levels and several subjects. Teachers described their patterns of test use, concerns about assessment, and use of performance testing. Teacher-developed performance assessment was heavily used. (Author/GDC)

This directory is intended to provide technical assistance for Nevada school districts and other evaluators of preschool children in selecting appropriate instruments to use in the multidisciplinary process for special education eligibility. It is not a list of approved tests, and tests not listed in this directory may be appropriate for…

Both norm-referenced and criterion-referenced interpretations of student, school, district, and state testing data can be improved by customizing the traditional norm-referenced test. Improvements that can be made include: (1) increasing the relevance of the test to the curriculum and (2) having greater confidence in the national comparative…

Standardized achievement tests are often misused as indicators of a school's quality or effectiveness relative to other schools. This is an incorrect use because it ignores variation among schools in student abilities, family support of education, student mobility, and other factors. People also misuse tests because they impute to them more…

This booklet is designed to help parents gain a better understanding of testing and its role in the education of their children. Answers to questions concerning the different types of tests given in schools, differences among these tests, how test results are used, what test scores mean and how the scores affect students are provided. Several…

The perceived needs of public school personnel in Wyoming with respect to the development and use of criterion-referenced tests (CRTs) as part of a district-wide testing program were assessed using a survey designed for the study. Questionnaires were sent to all superintendents, assistant superintendents, and curriculum directors in the state. Of…