The utility of modified item response theory (IRT) models in small sample testing applications was studied. The modified IRT models were modifications of the one- and two-parameter logistic models. One-, two-, and three-parameter models were also studied. Test data were from 4 years of a national certification examination for persons desiring…

The Connecticut Assessment of Educational Progress (CAEP) is designed to provide legislators and educators with information on the strengths and weaknesses of students in 11 curricula areas. In addition, the Educational Evaluation and Remedial Assistance (EERA) program was developed to assess student proficiency in the basic skills of reading,…

This paper describes the approach to consolidating multiple measures of student achievement used by the Long Beach Unified School District (LBUSD) in the 1997-1998 reporting cycle. Beginning in 1996-1997, all California schools that served Title I students or were involved in the state's Coordinated Compliance Review process were required to…

This paper presents two examples of how methodological research in testing and evaluation simultaneously served the needs of both researchers and practitioners. The first example focuses on Center for the Study of Evaluation (CSE) research in writing assessment. This research investigated issues in domain definition, cognitive processing…

The multimethod approach used to collect a assessment data at the local and state levels for the Louisiana Teacher Assessment Program is described. This program develops information about a new teacher's competence that can be used to suggest instructional improvement activities and to decide on qualifications for certification. The first…

Commemorating the work of Anne Cleary, the author considers the need for research on assessment in the practice context, provides an example of research in context, and proposes general areas of development for assessment research in the context of practice. Research has shown that effects of testing programs on practice are often not those that…

Efficient methods of using the Statistical Package for the Social Sciences (SPSS) to analyze National Assessment of Educational Progress (NAEP) data files are discussed. One error in the NAEP SPSS file is discussed, and another error (which may be system-dependent) is mentioned. In addition, purely mathematical methods are used to address the…

As the latest in a series of studies analyzing the data reported on Tennessee's school district report cards, this paper focuses on finding a common statistical treatment to examine the impact of predictor variables on dependent variables. Investigations of the 1988-89 report card data explored the relationships among eight school district…

The purpose of this study was to improve both statistical and judgmental methods for detecting potentially biased test items in an attempt to examine the agreement between the results obtained with these methods. If greater agreement between methods can be achieved, test items can be more effectively screened using judgmental methods prior to…

Connecticut is developing a new grade 10 statewide testing program known as the Connecticut Academic Performance Test (CAPT). The CAPT reflects the changing nature of standardized assessment by using a variety of assessment formats including performance tasks, open-ended questions, and multiple-choice tests. This paper describes the research that…

This research, conducted for California State Department of Education, is one component of a feasibility study focusing on ways to make the testing process more efficient by application of multi-purpose tests (MPT). MPT are designed, administered and scored to serve more than one purpose and to consolidate and unify testing programs as a partial…

The agreement between Mantel-Haenszel and Rasch procedures for identifying differential item functioning (DIF) on teacher certification tests was studied. Two specific research questions were addressed: (1) whether the Mantel-Haenszel and Rasch procedures identify the same items as functioning differently; and (2) how consistently each method…

Recent investigations of the extent to which students with disabilities are allowed to participate in major national data collections used in measurement-driven education reform suggest that 40 to 50 percent of students with disabilities are typically excluded from major assessments, although they are included to a greater degree in assessments…

School effectiveness indices (SEIs), based on regressing test performance onto earlier test performance and a socioeconomic status measure, were obtained for eight subject-grade combinations from 485 South Carolina elementary schools. The analysis involved school means based on longitudinally matched student data. Reading and mathematics…

In 1983 the Maryland State Department of Public Education (MSDE) issued a request for proposals for "The Development of the Score Reporting System for the Maryland Functional Testing Program." The MSDE called for a literature review, a national survey, a statewide survey of user needs and capabilities, an assessment of the state's report…