In 1994 the Federation of State Medical Boards and the National Board of Medical Examiners instituted a three-step U.S. Medical Licensing Examination (USMLE). Step one of the USMLE may be vulnerable to legal challenge on the basis of minority group bias and lack of construct validity. (SLD)

The cultures of accountability and validity are at odds in high-stakes testing. When the polis demands that tests serve high-stakes accountability functioning, professional testing standards are often compromised. Using flawed indicators can produce unreliable, unrepresentative inferences and decisions. High-stakes testing produces teaching and…

Achievement gaps between minority and white students may never be resolved because they are an artifact of a measurement process that uses flawed tests to assess student progress. IQ and achievement testing have always shown that socioeconomic status (SES) is critical in explaining test score variance. SES is part of the concept of cultural…

The first goal of this article is to discuss the role of nonverbal ability tests in the identification of academically gifted children. I note that most nonverbal tests measure verbally mediated cognitive processes, that they are neither "culture flee" nor "culture fair," and that we have known these facts for a very long time. I show that…

We explore the relationship between the signalling role of education and direct screening measures adopted by employers using a matched employee-employer data set drawn from the 1998 "Workplace Employee Relations Survey" for Great Britain. We identify which firms use personality/attitude and/or performance/competency tests during the…

Purpose: African American students perform disproportionately more poorly on standardized reading assessments than their majority peers. Poor reading performances may be related to test biases inherent in standardized reading instruments. The purpose of this investigation was to examine the appropriateness of the Gray Oral Reading Tests-Third…

The authors describe a potential disconnect between research and practice in literacy assessment and instruction. They organize discussion around professionally recognized standards for the evaluation of educational assessments and assessment practices. These standards address both technical aspects of tests (e.g., validity; reliability;…

Almost 20 years ago, the author wrote--and then privately published--the two "Lake Woebegone" reports, named after Garrison Keillor's mythical Minnesota town where "all the women are strong, all the men are good-looking, and all the children are above average." The first "Lake Woebegone" report documented that all 50 states were testing above the…

Objective: First, to provide information about best practices in handling missing data so that readers can judge the quality of research studies. Second, to provide more detailed information about missing data analysis techniques and software on the Journal's Web site at www.jaacap.com. Method: We focus our review of techniques on those that are…

The issue of unfairness arises in high-stakes public examinations when students choose questions from alternatives that are offered and marks on the alternatives turn out to be discrepant. This paper addresses and defines unfairness and discrepancy in the context of alternative questions in Physics Tertiary Entrance Examinations (TEE) in Western…

Summative measures of learning collected at the conclusion of an associate or bachelor's degree program are insufficient to help educators and students maximize learning and personal development across the college years. Managing the desired outcomes of college requires an understanding of when learning and growth occur during the educational…

This article presents the lessons that a team of evaluators learned during a study of a multicultural initiative in a large, Midwestern school district. During the evaluation process, three incidents brought the evaluators' multicultural best intentions into sharp focus. This article describes the evaluation's framework and process and then…

The present study utilized both the IRT-LR (item response theory likelihood ratio) and a series of CFA (confirmatory factor analysis) multi-sample analyses to systematically examine the relationships between DIF (differential item functioning) and DTF (differential test functioning) with a random sample of 15 000 Korean examinees. Specifically,…

Hispanics have become the largest minority group in the United States. Hispanic children typically come from working class homes with parents who have limited English language skills and educational training. This presents challenges to psychologists who assess these children using traditional IQ tests because of the considerable verbal and…

The "Standards for Educational and Psychological Testing" of the American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education are intended to provide a comprehensive basis for evaluating tests. This digest identifies key standards applicable to most test…