In 1998, the Kentucky legislature made adjustments to the assessment and accountability system established by the Kentucky Education Reform Act of 1990 to create a new system, the Commonwealth Accountability and Testing System (CATS). The Kentucky Core Content Tests (KCCT) are a component of CATS. KCCT assessments are given in grades 4, 5, 7, 8,…

This paper reports the results of generalizability theory (G) analyses done for new writing and speaking tasks for the Test of English as a Foreign Language (TOEFL). For writing, a special focus was placed on evaluating the impact on the reliability of the number of raters (or ratings) per essay (one or two) and the number of tasks (one, two, or…

Maryland School Performance Assessment Program (MSPAP) assessments are criterion-referenced performance tests designed, developed, and implemented by the Maryland State Department of Education in collaboration with classroom teachers and other Maryland educators. MSPAP is the major strategy for implementing Maryland's educational reform…

Maryland School Performance Assessment Program (MSPAP) assessments are criterion-referenced performance tests designed, developed, and implemented by the Maryland State Department of Education in collaboration with classroom teachers and other Maryland educators. MSPAP is the major strategy for implementing Maryland's educational reform…

Maryland School Performance Assessment Program (MSPAP) assessments are criterion-referenced performance tests designed, developed, and implemented by the Maryland State Department of Education in collaboration with classroom teachers and other Maryland educators. MSPAP is the major strategy for implementing Maryland's educational reform…

Few individuals in the history of education have had greater impact on education policy and practice than Benjamin S. Bloom. During a career that spanned more than 5 decades, his research and writing guided the development of many educational programs and provided insights into the untapped potential of educators to have all students learn well.…

This paper describes the creation of the National Assessment Governing Board (NAGB) in 1998 and examines the background characteristics of the Board members and their attendance at NAGB meetings. The staffing and financing of the NAGB and the relationship between the agency and the National Center for Education Statistics is also considered. The…

To reduce the cost of item writing and to enhance the flexibility of item presentation, items can be generated by item-cloning techniques. An important consequence of cloning is that it may cause variability on the item parameters. Therefore, a multilevel item response model is presented in which it is assumed that the item parameters of a…

This "Research to Practice Note" provides an overview of the cognitive science and measurement theory and research findings that support the EFF approach to assessment. Among the key findings addressed are the following: (1) Good assessment is grounded in a clear and explicit model of the cognitive processes that underlie complex and purposeful…

This study uses met expectations hypothesis, a form of expectancy theory, to develop survey instruments to identify and compare the goals, expectations, and perceived outcomes stakeholders held for the Faculty Development Institute (FDI). The stakeholders had similar expectations for the outcomes during and/or immediately following the initial FDI…

This paper describes some results of a collaborative effort between the University of Pittsburgh and the Air Force to develop advanced troubleshooting training for F-15 maintenance technicians. The focus is on the cognitive task methodology used in the development of three intelligent tutoring systems to inform their instructional content and…

The purpose of this study was twofold: to develop teachers' assessment skills and to enable teachers to apply this knowledge to the creation of assessment tasks for the language arts curriculum thereby linking curriculum to assessment. Using a newly developed language arts curriculum, 79 urban Connecticut teachers were asked to develop the…

A discussion of language testing addresses three questions: why good test construction seems to be increasingly difficult; what forces are shaping the practice of test construction; and what lies ahead in testing. It is proposed that practitioners are constantly redefining what "good" tests are, and those who develop tests are facing greater and…

This report, requested by the Massachusetts Department of Education, addresses the issue of the format of native language assessments of students' educational achievement. There are two basic options when administering a translation or adaptation of a test in another language: one is to produce test booklets in both languages and then determine…

In three lectures, Benjamin D. Wright of the University of Chicago introduces the Rasch model and its basic concepts. The first lecture, March 30, 1994 discusses the model created by Georg Rasch, a Danish mathematician, which Dr. Wright initially saw as merely a way to make raw scores into measures. Eventually, the model developed into a…