This study investigated the application of multidimensional item response theory (IRT) models to validate test structure and dimensionality. Multiple content areas or domains within a single subject often exist in large-scale achievement tests. Such areas or domains may cause multidimensionality or local item dependence, which both violate the…

This study examines the practical implications of using state tests to measure student achievement in impact evaluations that span multiple states and grades. In particular, the study examines the sensitivity of impact findings to (1) the type of assessment used to measured achievement (state tests or an external assessment administered by the…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

Securing data on students' academic achievement is typically one of the most important and costly aspects of conducting education experiments. As state assessment programs have become practically universal and more uniform in terms of grades and subjects tested, the relative appeal of using state tests as a source of study outcome measures has…

Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

The steps discussed are (a) stating the purpose of the battery, (b) specifying performance objectives, (c) generating an item pool, (d) item analysis, (e) item selection, (f) determining cut-off scores, and (g) validating the battery. (MP)

Replies to the immediately preceding article. (IRT)

Due to the recent Federal redefinition of "basic skills," large scale assessments of speaking and listening proficiencies will proliferate. In planning assessment procedures, educators must be sensitive not only to psychometric validity, but also to pedagogical validity: the effects of testing on curricular content and instructional strategies.…

Comments on the strengths and weaknesses of the reading portions of the California Achievement Tests. (JT)

Offers a preliminary assessment of the new Arizona Student Assessment Program (ASAP). Uses James Squire's model for analyzing reading and writing processes to analyze how well the tests assess reading processes. Includes some sample ASAP forms. Finds that the problems are minor in terms of evaluating the overall effectiveness of the new…

The Arizona Tax Research Association analyzed the Arizona Teacher Proficiency Examination (ATPE). An item analysis of the 150 questions administered to 2,430 applicants from July 1982 through March 1983 was undertaken. A minimum point biserial correlation coefficient of .33 indicated the validity of an item. Nearly two-thirds (64 percent) of the…

Based on 18 months of extensive research and study, the New Mexico State Department of Education developed the Staff Accountability Plan to address the issue of teacher accountability and certification. One of the provisions of the plan (a written assessment of general and professional knowledge for initial certification) will be fulfilled by…

Barbara Jordan served as the hearing officer for three-day adversary evaluation hearings about the pros and cons of minimum competency testing (MCT). This report is the complete transcript of the second day of proceedings. The pro team, lead by James Popham, began by presenting representatives of four states (Florida, California, Texas, and…

Reports on an ongoing evaluation of the Vermont portfolio assessment program. Indicates that the positive news about the instructional effects of the assessment program are in contrast with the empirical findings about the quality of the data the program has yielded. (SLD)

Research on the lack of correlation between standardized tests and school district goals has suggested that district goals might be better met by supplementing standardized tests with district-made criterion-referenced testing systems. This article reports on the development of such a system, the Academic Learning Progress Assessment System…