The purpose of this study was to apply two types of Differential Item Functioning (DIF), net and global DIF, as well as the framework of Differential Step Functioning (DSF) to real testing data to investigate measurement invariance related to test language. Data from the Program for International Student Assessment (PISA)-2006 polytomously scored…

Papay (2011) noticed that teacher value-added measures (VAMs) from a statistical model using the most common pre/post testing timeframe--current-year spring relative to previous spring (SS)--are essentially unrelated to those same teachers' VAMs when instead using next-fall relative to current-fall (FF). This is concerning since this choice--made…

Licensure testing programs in the United States (e.g., nursing) face an increasing challenge of measuring the competency of internationally trained candidates, both in relation to their clinical competence and their English language competence. To assist with the latter, professional licensing bodies often adopt well-established and widely…

Recent reports of high levels of achievement on the Regents examinations in New York state and relatively poor showing on the eighth grade examinations have led many to speculate that the eighth grade examinations lack good predictive properties with respect to the Regents examinations. There are many problems with arriving at such a conclusion,…

The effect of rapid feedback for a state writing assessment on subsequent writing performance was investigated. In addition, the agreement between teachers' scores for the state writing assessment and state department scores was analyzed. Eighth grade English teachers (n=8) were trained in analytic trait scoring of writing assessments. They then…

The Delaware Student Testing Program (DSTP) is a mandated statewide assessment program that targets four core content areas. English language arts, including reading and writing, and mathematics are given to students in grades 3, 5, 8, and 10; science and social studies are given to students in grades 4, 6, 8, and 11. The DSTP reading and…

This study explored the performance of students with disabilities on a field test of the revised New York State Regents Comprehensive Examination in English, the first of two new Regents examinations that almost all students in the state will have to take to obtain a high school diploma. Data from the field test were gathered statewide, although…

The consequences of large state testing are often uniformity of expectations for achievement. The largest impact of higher standards, then, are realized by traditionally disenfranchised student populations, particularly the least affluent who are most likely to bear the yoke of low expectation. This paper advances S. Messick's (1981) fundamental…

This study investigated the possible impacts of language and curriculum differences on the performance of test items by subpopulations of students. Focusing on Measurement and Geometry items completed by students in French- and English-language schools in Ontario made it possible to explore the differences and to compare the item response theory…

Presents the preliminary results of a comparison of Computerized Adaptive Testing (CAT) and conventional testing of English competency for students with limited English proficiency. The CAT procedure, which uses computers and a measurement theory known as Item Response Theory (IRT), provides several benefits that traditional paper and pencil…

Results of the Diploma Examinations Program conducted by Alberta Education during June 1989 are provided. This report is designed to assist policymakers and educators in reviewing the effectiveness of their programs and in reinforcing instructional successes previously achieved. The grade 12 program is intended to develop and maintain excellence…

The Grade 12 Diploma Examination Program, an integral part of high school diploma requirements, is intended to develop and maintain excellence in educational standards through certification of academic achievement. It consists of course-specific examinations that are based on the prescribed Program of Studies for Senior High Schools for the…

The use of a basic skills testing program to identify and remediate academic weaknesses of adult reentry graduate students (mean age 30.1 years) was studied longitudinally. The entering masters' level students majoring in business administration were studied in fall 1980 and again after the spring/summer registration of 1984. Through assessment…

Statistical data and comments describe the results of the 1977 eighth grade testing program in Ontario, Canada. The tests were: Mathematics (in French and English), Problem Solving (in French and English); Science (in English only), Attitudes, French Comprehension, and Written English. Table 1 presents the numbers of students, by school district,…

The annual report on achievement testing in Alberta (Canada) includes test results for third-grade students in language learning (for the regular English program), sixth-grade students in social studies, and ninth-grade students in science. Results are regarded in terms of curriculum standards, assessment standards, and achievement standards.…