The 12th annual William H. Angoff Memorial Lecture was presented by Dr. Michael T. Kane, ETS's (Educational Testing Service) Samuel J. Messick Chair in Test Validity and the former Director of Research at the National Conference of Bar Examiners. Dr. Kane argues that it is important for policymakers to recognize the impact of errors of measurement…

Presents a comprehensive review of validity that includes an empirical evaluation of the actual and potential consequences of score interpretation and use, how those consequences come about, and what determines them. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of…

In this speech, the author covers a lot of ground. In the first half of his speech, the author gives a brief summary of the last 40 years of the history of language testing, from his perspective. The author reviews these years more or less by decade. Additionally, he discusses the evolution of the profession of language testing during this period,…

Presents a unified concept of test validity that integrates both the scientific and ethical considerations of test interpretation and use. Argues that the appropriateness, meaningfulness, and usefulness of score-based inferences are inseparable, and that this integration is based on construct validity. (FMW)

By focusing on "appropriateness" and "adequacy" of inference and action, unified validity may be misused in rejecting valid test outcomes. The notion of levels of validity is challenged, the necessity of assumption is argued, and experience is proposed as the basis of validity. "Consequential validity" is interpreted as an optional predictive…

This paper focuses on issues of data trustworthiness in praxis-oriented empirical work, research openly committed to the building of a world in which we can all flourish. The central argument is that those exploring the possibilities for a change-enhancing advocacy paradigm for doing empirical research in the human sciences must begin to be more…

A study by Malcolm R. Parks reported in "Communication Monographs" called into question the cross-situational validity of the Personal Report of Communication Apprehension (PRCA). Park's study, however, is flawed in many ways. He does not provide an adequate definition of "situation." Both the type of factor analysis he chose…

NCATE (2002) requires the measurement of knowledge, skills, and dispositions as part of its accreditation requirements for teacher education programs (Standard 1) and the use of unit assessment systems to aggregate and analyse data with a view toward program improvement (Standard 2). Data must indicate that candidates meet professional, state, and…

An experiment is deemed to be valid, inasmuch as valid cause-effect relationships are established, if the results are due only to the manipulated independent variable (possess internal validity) and are generalizable to groups, environments, and contexts outside of the experimental settings (possess external validity). Consequently, all…

Problems in validating ability tests for handicapped students and research approaches to predictive validity are discussed. Validity for handicapped persons tested under regular conditions; for applicants to special programs, and for tests taken under special administrative conditions are considered. Item analysis and the construction of new…

Implicit in the work of S. Huck and H. Sandler (1979) is the idea that the concept "rival hypotheses" refers to some kind of alternative explanation. Rather than being threats to internal validity, rival hypotheses, in their view, are interpretations that differ from those of the researcher. This paper broadens the idea to include any…

A review of court cases, involving the use of various standardized tests, highlights the kinds of test validity and the interpretation by the courts of test fairness in setting personnel selection standards. Guidelines established by the Equal Employment Opportunity Commission (EEOC) are shown to support the use of predictive validity in…

The program evaluation standards approved by the American National Standards Institute (ANSI) in 1994 that deal with reliability and validity accurately represent contemporary views of the psychometric community with regard to reliability and validity. As such, these standards move the field forward. The ANSI standards recognize that reliability…

This paper addresses a variation of the traditional validity question asked of qualitative researchers. Here the question is not "How do we know the qualitative researcher's question is valid?" but rather, "How does the qualitative researcher choose from among a multitude of apparently valid or at least plausible…

This paper provides a rationale for using and sustaining rival hypotheses Web-based tools to promote students' understanding of the concepts of internal and external validity. Five major concerns are identified. The first is that, in their present form, the Web sites subsume the discussion of threats to validity under experimental designs, giving…