Despite agreement about the central importance of validity for educational and psychological testing, consensus regarding the definition of validity remains elusive. Differences in the definition of validity are examined and reveals that a potential cause of disagreement stems from differences in word use and meanings given to key terms commonly…

With the 2014 publication of the 5th revision of the "Standards for Educational and Psychological Testing," the cochairs of the Joint Committee for the revision process were asked to consider the role and importance of the "Standards" for the educational testing community, and in particular for members of the National Council…

The ability to convey shared meaning with minimal ambiguity is highly desirable for technical terms within disciplines and professions. Unfortunately, there is no widespread professional consensus over the meaning of the word "validity" as it pertains to educational and psychological testing. After illustrating the nature and extent of…

A misconception exists that validity may refer only to the "interpretation" of test scores and not to the "uses" of those scores. The development and evolution of validity theory illustrate test score interpretation was a primary focus in the earliest days of modern testing, and that validating interpretations derived from test…

Item calibration is an essential issue in modern item response theory based psychological or educational testing. Due to the popularity of computerized adaptive testing, methods to efficiently calibrate new items have become more important than that in the time when paper and pencil test administration is the norm. There are many calibration…

This article describes the 2009 revision of the Dutch Rating System for Test Quality and presents the results of test ratings from almost 30 years. The rating system evaluates the quality of a test on seven criteria: theoretical basis, quality of the testing materials, comprehensiveness of the manual, norms, reliability, construct validity, and…

This article reviews the "Wechsler Individual Achievement Test-Third Edition" (WIAT-III), a newly updated individual measure of academic achievement for students in Pre-Kindergarten through Grade 12 (age 4 years, 0 months to 19 years, 11 months). Suitable for use in educational, clinical, and research settings, the stated purposes of the WIAT-III…

The paper gives an overview of multidimensional adaptive testing (MAT) and evaluates its applicability in educational and psychological testing. The approach of Segall (1996) is described as a general framework for MAT. The main advantage of MAT is its capability to increase measurement efficiency. In simulation studies conceptualizing situations…

The psychometric literature is replete with comprehensive discussions of test validity, test validation, and the characteristics of quality assessment programs. The most authoritative source for guidance regarding sound test development and evaluation practices is the Standards for Educational and Psychological Testing. However, the Standards are…

This review employs a conceptual framework that distinguishes methods of detecting measurement bias based on either observed or unobserved conditional invariance models. The primary interest is in group-level measurement bias. Methods for bias detection in both continuous and ordered-categorical measures are reviewed, as are methods for testlets…

Three papers are included in this document. The first, "An Introduction to the Problem of Test User Qualifications," by Kevin L. Moreland, is a short history of the American Psychological Association (APA)/American Educational Research Association (AERA)/National Council on Measurement in Education (NCME) Working Group on Test User…

Assesses the measurement qualities of a computer-managed test of children's reading vocabulary, and the resultant representational patterns of vocabulary knowledge. Describes the test's administration, and its high reliability. Reveals that it shows that children of all ability levels know a range of very common to very rare words. (SKC)

Major changes underway with regard to educational assessment include an increased role for the federal government; increased emphasis on standards; and increased reliance on performance assessment. These changes are the context for the effort to revise the "Standards for Educational and Psychological Testing." (SLD)

The International Language Testing Association has some 250 members in 15 countries. Most are specialists in the testing of second language skills, with a special interest in performance assessment because of the testing of speaking and writing performance that is critical to second language skills assessment. The association believes that certain…

A method for analyzing test-item responses is proposed to examine differential item functioning (DIF) in multiple-choice items within the latent class framework. Different models for detection of DIF are formulated, defining the subgroup as a latent variable. An efficient estimation method is described and illustrated. (SLD)