This paper discusses the development of an assessment to satisfy the International Civil Aviation Organization (ICAO) Language Proficiency Requirements. The Versant Aviation English Test utilizes speech recognition technology and a computerized testing platform, such that test administration and scoring are fully automated. Developed in…

Practitioners working closely with second language (L2) writers in the US recognize at least two types of L2 students: international (IL2) and Generation 1.5 (G1.5) students. Some argue that specific differences in each group's writing performance are evident (cf. Harklau, 2003; Reid, 2006); however, investigations into observable and measurable…

Preliminary pilot studies and a field study show how a generalizable conceptual framework calibrated with item response modeling can be used to describe the development of student conceptual understanding in chemistry. ChemQuery is an assessment system that uses a framework of the key ideas in the discipline, called the Perspectives of Chemists,…

This workbook is about producing the "Inquiry Brief" or "Inquiry Brief Proposal" for TEAC (Teacher Education Accreditation Council) accreditation. It is designed as a companion to the TEAC "Guide to Accreditation." The exercises in this workbook are selected by the writing workshop presenters to help program faculty get started on their "Brief."…

The main purpose of this study is to develop a Spanish language screening measure that (a) is valid and reliable for the purpose of identifying Spanish-speaking (SS) children at risk for Language Impairment (LI), (b) is valid and reliable across different Spanish dialects, different socioeconomic groups, and different ethnicities, (c) uses a…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

Teacher Work Samples (TWS) can be viewed in terms of a product and a process. As a product, the TWS measures a teacher candidate's (TC's) ability to promote student achievement, documents that TCs have met minimum national standards, and validates teacher education programs. Teacher candidates engage in observable, job-related behaviors that serve…

As constructed-response items become an integral part of educational assessments, setting student performance standards on constructed-response items has become an important issue. Two standard-setting methods, one used for setting standards on the National Assessment of Educational Progress (NAEP) in reading in grade 8 and the other used to set…

This paper reports 20 unsolved problems in educational measurement and points toward what seem to be promising avenues of solution. The first group of concerns involves validity, posing the problems of obtaining suitable validity criteria, determining and measuring the predictor variables that best characterize the traits and proficiencies of…

The validity of combining a correction for guessing with the Nedelsky-based cutscore was investigated. A five option multiple choice Mathematics Achievement Test was used in the study. Items were selected to meet several criteria. These included: the capability of measuring mathematics concepts related to performance in introductory statistics;…

The purpose of this study was to determine whether it would be possible to equate rights-scored to formula-scored tests without causing a discontinuity in the meaning of the score scale. Several other subsidiary studies--of the characteristics of the two scoring methods, of nonresponse and guessing, and of reliability and parallelism--were also…

Rubrics are tools that formalize the process of evaluation by explicitly stating the criteria to be used for grading. Rubrics help students to evaluate the quality of their work as they progress through a class. They may be very helpful to Ohio adult educators in helping to evaluate the Uniform Portfolio that must be kept on every student within a…

The cognitive components standard setting method, recently introduced by D. McGinty and J. Neel (1996), asks judges to specify minimum levels of performance not for the test items, but for smaller portions of items, the component skills and concepts required to answer each item correctly. Items are decomposed into these components before judges…

This book presents a rationale for learning-centered assessments in schools and an overview of the tools, techniques, and issues that educators should consider as they design and use assessments focused on learner needs. The proposals in this book are based on the premise that assessment should be deliberately designed to improve and educate…

This booklet is designed to help parents and community members answer questions about assessment in the context of the Vermont Framework of Standards, the Equal Education Opportunity Act of 1997, and other statewide initiatives. Assessment is changing in Vermont in response to new legislative mandates that call for standards-based assessment…