Describes the development of the Secondary Level English Proficiency (SLEP) Test specifications and the performance of each item type during administration of the test in other countries. Innovative formats such as multiple-choice cloze and multiple-choice dictation are discussed and described. In addition, the findings of a validity study…

Building capacity within schools and districts for continuous improvement is a goal of educators at all levels across the United States of America. An important first step in capacity building is identifying schools' current strengths and weaknesses. Schools can then begin building upon existing strengths to implement improvement initiatives.…

This document is a summary of the findings of an extensive review by the Education Commission of the States (ECS) of empirical research on the effectiveness of current approaches to licensing and certifying teachers. The research review focused on eight questions (and several subquestions) that are of particular interest and concern to policy and…

Year-to-year rater variation may result in constructed response (CR) parameter changes, making CR items inappropriate to use in anchor sets for linking or equating. This study demonstrates how rater severity affected the writing and reading scores. Rater adjustments were made to statewide results using an item response theory (IRT) methodology…

Ensuring that language tests for adult English language learners are appropriate, valid, and reliable is a challenge. Performance-based assessments are complex to develop and implement. Yet, because the focus of assessment, both in the National Reporting System for Adult Education (NRS) descriptors and in the Department of Education's definition…

The paper initially describes the sources of uncertainty in National Assessment of Educational Progress (NAEP) data and standard errors. As NAEP sample sizes have increased, greater precision has been attained by the program. For this reason, exclusion effects are increasingly important. Two scenarios of revised NAEP results are presented (for New…

To find ways to improve rater reliability of a tape-mediated speaking test for Japanese university students of English as a Second Language, two studies gathered information on: how raters actually made their choices on rating sheets of students' speaking ability; determined what criteria teachers think they use and actually use in rating…

The reliability and factorial validity of the Computer Attitudes Scale (CAS) was assessed with college students in South Korea. The CAS was developed for use with high school students, but has been used in higher education in the United States. It is a Likert-type scale of 30 positive and negative statements about the use of computers, and is one…

The extensive computer simulation work done in developing the computer adaptive versions of the Graduate Record Examinations (GRE) Board General Test and the College Board Admissions Testing Program (ATP) Scholastic Aptitude Test (SAT) is described in this report. Both the GRE General and SAT computer adaptive tests (CATs), which are fixed length…

This text offers teachers and education majors practical, step-by-step guidance on how to create and use assessments. It can serve as the textbook for an undergraduate or first graduate course in educational assessment. This third edition focuses more clearly on classroom assessment than the previous editions. Each chapter has been revised with…

This workbook is one of six professional development manuals prepared by experienced adult assessment staff to help new adult education (AE) instructors understand how to administer and interpret standardized tests and how such standardized tests can provide one basis for instructional placement and curriculum choices. It also provides information…

This paper describes the development work and research findings of an initiative to create a statewide literacy assessment in New York to inform teaching and learning and report on group performance trends. The Early Literacy Profile (ELP) is a classroom-based, standards-referenced performance assessment for students in the primary grades…

This study sought to develop a valid and reliable instrument to measure student perceptions of good college teaching from a cross-cultural perspective. A total of 63 graduate and undergraduate students from various ethnic and racial groups (Caucasian, African American, Hispanic American, and Asian American) completed a set of open-ended questions…

This book focuses on the professional practices of elementary and secondary school teachers. It can serve as the textbook for an undergraduate or first graduate course in educational assessment, and no formal work in statistics or college mathematics is necessary to understand the text. The chapters are: (1) "Classroom Decision Making and Using…

The current national debate about higher education has focused heavily on varying interpretations of the U.S. higher education system's accountability structures. Much of that debate has emphasized undergraduate learning and the specific issues of student engagement and outcomes. But relatively little attention has been paid at either the state or…