Despite agreement about the central importance of validity for educational and psychological testing, consensus regarding the definition of validity remains elusive. Differences in the definition of validity are examined and reveals that a potential cause of disagreement stems from differences in word use and meanings given to key terms commonly…

One of the substantive changes in the 2014 Standards for Educational and Psychological Testing was the elevation of fairness in testing as a foundational element of practice in addition to validity and reliability. Previous research indicates that testing practices often do not align with professional standards and guidelines. Therefore, to raise…

With the 2014 publication of the 5th revision of the "Standards for Educational and Psychological Testing," the cochairs of the Joint Committee for the revision process were asked to consider the role and importance of the "Standards" for the educational testing community, and in particular for members of the National Council…

Some of the challenges that test publishers face in constructing educational assessments that meet high technical quality as prescribed in the "Standards for Educational and Psychological Testing" (AERA, APA, NCME, 1999) are examined. Federal educational initiatives are used to illustrate demands on technical quality that challenge the efforts of…

The "Standards for Educational and Psychological Testing" have evolved in the breadth and depth of coverage of issues in educational testing and measurement since their first publication in 1954. There were a number of substantive changes in the 1999 revision that addressed validity, fairness, accommodations, and compliance with the…

The psychometric literature is replete with comprehensive discussions of test validity, test validation, and the characteristics of quality assessment programs. The most authoritative source for guidance regarding sound test development and evaluation practices is the Standards for Educational and Psychological Testing. However, the Standards are…

The goal of the Standards for Educational and Psychological Testing is to improve testing practices, but their impact on practice appears spotty. Self-regulation clearly fails in some instances. The establishment of an external agency to oversee testing practices and adherence to the Standards would face substantial hurdles, and the ambiguity of…

The gap between professionally and legally acceptable practice in professional licensure tests is addressed. Pertinent activities of the American Psychological Association, American Educational Research Association, and the National Council for Measurement in Education are discussed. (TJH)

The Presidential Address at the 1986 National Council on Measurement in Education Annual Meeting argues that measurement specialists have tended to set unrealistic aspirations for the role tests play. The conjunctive decision making model is discussed and the use of data in the conjunctive and compensatory decision making models is examined. (JAZ)

Discrepancies between court and professional association views of licensing examinations are discussed. Litigation associated with Title VII of the Civil Rights Act of 1964 and constitutional law is considered. Courts should examine professional standards and apply those that are consistent with the court's determination of the proper…