An important issue in educational and employment settings is the degree to which evidence of validity obtained in one situation can be generalized to another situation without further study of validity in the new situation. Theory, procedures, and applications concerning validity generalization are addressed. Meta-analytic techniques make possible…

The "Standards for Educational and Psychological Testing" of the American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education are intended to provide a comprehensive basis for evaluating tests. This digest identifies key standards applicable to most test…

This Digest, intended as an instructional aid for beginning research students and a refresher for researchers in the field, identifies key factors that play a critical role in determining the credibility that should be given to a specific research study. The needs for empirical research, randomization and control, and significance testing are…

Matrix sampling of test items, the division of a set of items into different versions of a test form, is used by several large-scale testing programs. This Digest discusses nine categories of costs associated with matrix sampling. These categories are: (1) development costs; (2) materials costs; (3) administration costs; (4) educational costs; (5)…

Test validity refers to the degree to which the inferences based on test scores are meaningful, useful, and appropriate. Thus, test validity is a characteristic of a test when it is administered to a particular population. This article introduces the modern concepts of validity advanced by S. Messick (1989, 1996, 1996). Traditionally, the means of…

Research on student evaluation of college teachers' performance is briefly summarized. Lawrence M. Aleamoni offers four arguments in favor of student ratings: (1) students are the main source of information about the educational environment; (2) students are the most logical evaluators of student satisfaction and effectiveness of course elements;…

This digest offers principles of performance assessment as an alternative to norm-referenced tests. The definition of performance assessment developed by the U.S. Congress's Office of Technology and Assessment is given, common features are listed, and the terms "performance" and "authentic" are defined. Suggested guidelines for…

The oral interview (OI) is a testing procedure that measures a wide range of speaking abilities in a foreign language. Although somewhat different versions are used in different testing situations, the OI always consists of a structured, face-to-face conversation on a variety of topics between a student and one or two testers. The resulting speech…

Despite a significant increase in test usage, numerous issues surrounding reading assessment remain unresolved. Construct validity--whether the test actually measures aspects of the behavior under consideration--is of particular importance if one is to rely on test scores to direct instruction, predict performance, or determine accountability. A…

Offers suggestions for identifying and instructing the verbally gifted. (JL)

This annotated bibliography of materials in the ERIC database contains 30 annotations (dating from 1974 to 1989) on informal reading inventories (IRIs). The citations were selected to help professionals understand the history of, the uses of, and the issues surrounding IRIs. The major sections of the bibliography are: Overview, General Uses,…

A synthesis of the report, "The Current State of Assessment in Literature," (produced by the Center for the Learning and Teaching of Literature), this digest discusses methods of evaluating students' knowledge of literature. The digest argues that, by and large, the tests that now exist in the United States do not live up to the…

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Screening programs are now widely used with children who are age-eligible for school entry. Screening is used to identify children who may be at risk of future difficulty in school (e.g., inability to meet academic expectations) and those who may have special needs in learning (e.g., extraordinary abilities and talents or handicapping conditions).…

The constructs used to evaluate research quality--valid, objective, reliable, generalizable, randomized, accurate, authentic--are not value-free. They all require human judgment, which is affected inevitably by cultural norms and values. In the case of research involving American Indians and Alaska Natives, assessments of research quality must be…