Using generalizability theory, this study examined both the rating variability and reliability of ESL students' writing in the provincial English examinations in Canada. Three years' data were used in order to complete the analyses and examine the stability of the results. The major research question that guided this study was: Are there any…

Two problems in the investigation of predictive bias in tests, the effect of unreliability of the predictors, and the effect of excluding a predictor from the regression equation on which there are preexisting group differences, are discussed. (Author)

Item bias, when present in a multiple-choice test, can be detected by appropriate analyses of the persons x items scoring matrix. Five related schemes for the statistical analysis of bias were applied to a widely used, primary skills multiple-choice test which was administered in either its English- or Spanish-language version at each of the two…

Models proposed by Cleary, Thorndike, Cole, Linn, Einhorn and Bass, Darlington, and Gross and Su for analyzing bias in the use of tests in a selection strategy are surveyed. Several additional models are also introduced. The purpose is to describe, compare, contrast, and evaluate these models while extracting such useful ideas as may be found in…

After a mailed questionnaire and two follow-ups, hard-core survey nonrespondents were contacted to ask why they had not responded and what they would have answered had they responded. Results from 28 subjects indicate that efforts to pursue nonrespondents may be unnecessary, because bias resulting from nonresponse appeared minimal. (SLD)

A comparison of bilingual Puerto Rican students' scores showed no significant differences between the Full Scale and the Verbal Scale scores on both tests, but significant differences between the Verbal and Performance Scale scores on both tests. Caution in testing bilingual children before determination of bilinguality is recommended. (Author)

The interest in the application of large-scale computerized adaptive testing has served to focus attention on issues that arise when theoretical advances are made operational. Some of these issues stem less from changes in testing conditions and more from changes in testing paradigms. One such issue is that of the order in which questions are…

Several methods of assessing test item bias are described, and the concept of fair use of tests is examined. A test item is biased if individuals of equal ability have different probabilities of attaining the item correct. The following seven general procedures used to examine test items for bias are summarized and discussed: (1) analysis of…

Twenty-one studies that reported mean score differences between the Woodcock-Johnson Tests of Cognitive Ability (WJTCA) and the Wechsler Intelligence Scale for Children-Revised (WISC-R) Full Scale are summarized. The differences are found to be minimal and are attributed to data bias and WJTCA's higher correlation with achievement. (EGS)

The performance of disabled and non-disabled students on college admissions test were compared. Performance of learning disabled and hearing impaired students appears most discrepant from the norm. Evidence relating to validity and reliability of admissions tests for handicapped and nondisabled examinees suggests no dependable differences in…

The National Assessment of Educational Progress (NAEP) is a survey of the educational achievement of American students and changes in their achievement across time. The NAEP has collected information for over 20 years to assist educators and policy makers. This guide intends to: document current NAEP methods for both state and national…

The National Assessment of Educational Progress (NAEP), often called the "Nation's Report Card," is the only nationally representative, continuing assessment of what U.S. students know and can do in various subject areas. NAEP provides a comprehensive measure of students' learning at critical junctures in their school experience. The…

Research on assessing the cultural fairness of individual test items is reviewed, with emphasis on Birnbaum's three-parameter logistic model. As defined in this review, differential item characteristics are exhibited when examinees from one group have a lower probability of answering correctly than do examinees of equal ability from another group.…

The purpose of the present study is to examine the April, 1974 Scholastic Aptitude Test (SAT) for item-content bias between the sexes. By so doing, this study forms a logical extention of the work of Coffman (1961) on the '54 SAT, and Donlon (1973) on the '64 SAT. A study of item-sex bias was conducted using the method of delta-plots (Angoff,…

To investigate the effect of time restraints on the diagnostic test scores of Native American students entering Bureau of Indian Affairs schools, two groups of students at Southwestern Indian Polytechnic Institute (SIPI) in Albuquerque, New Mexico, were given the Stanford Diagnostic Reading Test, (Blue Level), 1977 edition. The test scores…