By design, randomized experiments (XPs) rule out bias from confounded selection of participants into conditions. Quasi-experiments (QEs) are often considered second-best because they do not share this benefit. However, when results from XPs are used to generalize causal impacts, the benefit from unconfounded selection into conditions may be offset…

The redesigned "TOEIC Bridge"® tests were designed to evaluate test takers' English listening, reading, speaking, and writing skills in the context of everyday adult life. In this paper, we summarize the initial validity argument that supports the use of test scores for the purpose of selection, placement, and evaluation of a test…

Despite the often-negative discussion about testing in schools, assessments are a necessary and useful tool in the teaching and learning process. This is especially true when it comes to diagnostic and formative assessments, which give teachers real-time direction for what students need to learn to master course content. It is this space where the…

The purpose of this document is to identify and dispel rumors that are frequently cited about the SAT. The following is a compilation of nine popular rumors organized into three areas: "Student Demographics," "Test Preparation/Test Prediction," and "Test Utilization."

This report describes the purposes of benchmark assessments and provides recommendations for selecting and using benchmark assessments--addressing validity, alignment, reliability, fairness and bias and accessibility, instructional sensitivity, utility, and reporting issues. We also present recommendations on building capacity to support schools'…

Proposes additional ways for people in the measurement profession to think about the fairness of assessments and about the fairness of the uses of assessments. Suggests that measurement professionals must pay more attention to reducing group differences at the design stage of test development, to providing all examinees an opportunity to…

A note from the Working Group of the Joint Committee on Testing Practices: The "Code of Fair Testing Practices in Education (Code)" prepared by the Joint Committee on Testing Practices (JCTP) has just been revised for the first time since its initial introduction in 1988. The revision of the Code was inspired primarily by the revision of…

Presents examples of test bias and test misuse. Discusses FairTest (National Center for Fair and Open Testing) program areas and initiatives at the elementary, secondary, and higher education levels. Discusses keeping the community informed. (RS)

Because applicant populations for many jobs and educational opportunities are becoming increasingly multicultural, the whole issue of fairness in testing has become highly salient. In South Africa, a main reason for the poor performance of the economy is the failure to make optimal use of all manpower, one of the crippling legacies of the…

Several methods of assessing test item bias are described, and the concept of fair use of tests is examined. A test item is biased if individuals of equal ability have different probabilities of attaining the item correct. The following seven general procedures used to examine test items for bias are summarized and discussed: (1) analysis of…

After decades of criticism that standardized testing is culturally biased, the Educational Testing Service claims great strides in eliminating test bias in the Scholastic Assessment Tests and related tests and reports initiatives in cooperation with educators leading to better academic preparation for students of color. Critics still ask for…

The accuracy and fairness of standardized testing is taken very seriously in the education world. These issues are a major focus of both the testing experts who develop standardized tests and the researchers who endeavor to ensure a test's fairness, reliability, validity, and accuracy. But many issues remain both controversial and complex. The…

The Trial Lawyers for Public Justice are suing the National Collegiate Athletic Association (NCAA) for discrimination against blacks by using college entrance examination scores, allegedly racially and culturally biased, for admission of athletes. Other organizations have also protested the tests' use. The NCAA claims the standards are in place to…

Educators are concerned about overuse or inappropriate use of standardized test scores as graduate school admission criteria, particularly for minority groups. Efforts to reduce test bias are increasing, and admissions officers are encouraged to focus more on qualitative elements of applications, such as essays, letters of recommendation, and…

Because intelligence and culture are inextricably intertwined, the measurement of ability is difficult. Test material inevitably reflects the culture of the test developer. As a consequence of this culture-boundedness, a test might not measure the same thing in another culture, and scores might not be comparable across cultures. There are three…