In this article, we systematize the factors influencing performance and feasibility of automatic content scoring methods for short text responses. We argue that performance (i.e., how well an automatic system agrees with human judgments) mainly depends on the linguistic variance seen in the responses and that this variance is indirectly influenced…

The use of mixed-format tests made up of multiple-choice (MC) items and constructed response (CR) items is popular in large-scale testing programs, including the National Assessment of Educational Progress (NAEP) and many district- and state-level assessments in the United States. Rater effects, or raters' scoring tendencies that result in…

"Louisiana Believes" embraces the principle that all children can achieve at high levels, as evidenced in Louisiana's recent adoption of the Common Core State Standards (CCSS). "Louisiana Believes" also promotes the idea that Louisiana educators should be empowered to make decisions to support the success of their students. In…

This catalog lists research reports, research notes, and other publications available from the College Board's website. The catalog briefly describes research publications available free of charge. Introduced in 1981, the Research Report series includes studies and reviews in areas such as college admission, special populations, subgroup…

This technical report provides an overview of the New York State Alternate Assessment (NYSAA), including a description of the purpose of the NYSAA, the processes utilized to develop and implement the NYSAA program, and Stakeholder involvement in those processes. The purpose of this report is to document the technical aspects of the 2013-14 NYSAA.…

The Ohio Vocational Achievement Tests are specially designed instruments for use by teachers, supervisors, and administrators to evaluate and diagnose vocational achievement for improving instruction in secondary vocational programs at the 11th and 12th grade levels. This guide explains the Ohio Vocational Achievement Tests and how they are used.…

The process used in Ohio to reform the state dental licensing examination and incorporate a nonpatient (simulated) clinical procedure is described and the results summarized. Findings focus on the degree to which results of the new testing procedures differentiate dental students by class rank. (MSE)

The Advanced Placement (AP) program is a cooperative educational effort of secondary schools, colleges, and the College Board that consists of 30 college-level courses and examinations in 17 academic disciplines for highly motivated students in secondary schools. AP courses are offered in more than 11,000 high schools and are recognized by nearly…

The SAT® I: Reasoning Test is administered seven times a year. Primarily for security purposes, several different test forms are given at each administration. How is it possible to compare scores obtained from different test forms and from different test administrations? The purpose of this paper is to provide an overview of the statistical…

A study was undertaken to obtain direct empirical evidence for the validity and usefulness of English as a second language (ESL) placement of a shortened version of the Secondary Level English Proficiency (SLEP) Test being used in the Los Angeles Community College District (LACCD) and locally developed and scored writing tests. The LACCD provided…

A divergent thinking (DT) test format, scored for flexible and original thinking, is presented. The DT test format, designed to assess teacher competencies and estimate the transfer of competencies to new situations, was administered to graduate students enrolled in a testing course. The DT format allowed students to list phrases and sentence…

This paper summarizes the standardized procedures and psychometric standards states must follow in developing performance-based assessment. The National Reporting System (NRS), which serves as the accountability system for federally funded adult education and literacy programs, requires that states have their local programs assess educational gain…