Neil Dorans has made a career of advocating for the examinee. He continues to do so in his NCME career award address, providing a thought-provoking commentary on some current trends in educational measurement that could potentially affect the integrity of test scores. Concerns expressed in the address call attention to a conundrum that faces…

In response to Ebel's article (TM 508 146) the author points out that, in emphasizing what a test is intended to measure, the vital question of what should be measured is set aside. While explicit specifications for a test should be encouraged, questions of worth ought to be prominent in designing and selecting tests. (Author/LC)

The computer assisted testing (CAT) program at Florida State University's Assessment Resource Center is described. Three measurement issues (test quality, confidence in mastery decisions, and maintenance of test validity) and two instructional design issues (quality of instructional objectives and extended feedback following testing) important for…

The term "criterion-referenced measurement" has been so frequently used that accumulated surplus meaning has sometimes swamped the fundamental concept. Stripping away extraneous interpretations affirms the contemporary relevance of the concept. Substituting the term "construct-referenced" underscores the need for better…

Generalizability of performance-based assessment scores across raters and tasks is examined, focusing on implications of generalizability analyses for specific uses and interpretations of assessment results. Although it seems probable that assessment conditions, task characteristics, and interactions with instructional experiences affect the…

Incidents affecting the implementation of large-scale testing programs are described to illustrate associated problems. Issues addressed include creation of test materials, preparation of answer documents, transportation of test materials, scoring and analysis of tests, and dissemination and utilization of test results. (TJH)

The application of generalizability theory to the reliability and error variance estimation for performance assessment scores is discussed. Decision makers concerned with performance assessment need to realize the restrictions that limit generalizability such as limitations that lead to reductions in the number of tasks possible, rater quality,…

Content areas that should be included in testing and measurement courses, subsidiary skills, and means of rationalizing the content and skills are outlined. Areas include basic concepts, assessment uses, assessment planning and development, interpretation of assessments, description of results, evaluation and improvement of assessments, feedback…

The scales of the National Assessment of Educational Progress (NAEP), as constructed, do not yield meaningful criterion-referenced interpretations. Poorly defined NAEP goals and the present knowledge base do not allow the measurement of what examinees can and cannot do. Inappropriate interpretations of NAEP data are discussed, with specific…

Several issues facing the measurement community were brought on by the recent emphasis on stricter educational accountability measures. These testing issues include the limits of test scores, effects of testing on instruction, proper test use, importance of the test content, and defining the basics in education. (EGS)

Approximately 900 teachers in Virginia were surveyed to assess teachers' competencies in the 7 basic assessment areas identified in the "Standards for Teacher Competence in Educational Assessment of Students." Results will be used in designing training material in assessment for inservice teacher education. (SLD)

The effects of test performance of differentially written multiple-choice tests and test takers' cognitive style were studied for 47 graduate students and 35 public school and college teachers. Adhering to test-writing item guidelines resulted in mean scores basically the same for two groups of differing cognitive style. (SLD)