We explored three approaches to resolving or re-scoring constructed-response items in mixed-format assessments: rater agreement, person fit, and targeted double scoring (TDS). We used a simulation study to consider how the three approaches impact the psychometric properties of student achievement estimates, with an emphasis on person fit. We found…

Background: Working memory, the ability to store and process information, is strongly related to learning outcomes. Aims: The aim of the present study is to extend previous research on early learning and investigate the relationship between working memory, cognitive styles, and attainment in adolescents using both national curriculum tests and…

This paper provides a history of ETS's role in developing assessment instruments and psychometric procedures for measuring change in large-scale national assessments funded by the Longitudinal Studies branch of the National Center for Education Statistics. It documents the innovations developed during more than 30 years of working with…

As part of its College Readiness System, ACT offers the PLAN[R] program as a way for tenth-grade students to review their progress toward college readiness while there is still time to make necessary interventions. PLAN contains four tests--English, Mathematics, Reading, and Science. These tests are designed to measure students' curriculum-related…

In this article, we introduce a person-fit statistic called the hierarchy consistency index (HCI) to help detect misfitting item response vectors for tests developed and analyzed based on a cognitive model. The HCI ranges from -1.0 to 1.0, with values close to -1.0 indicating that students respond unexpectedly or differently from the responses…

It is essential for all students to be ready for college and career when they graduate from high school. Postsecondary educators expect high school graduates to be prepared academically for success in postsecondary education, which in turn influences success in the work world. Employers continue to call for workers to have the tools needed to…

Two hundred children (100 girls and 100 boys), kindergarten through fourth grade, were tested with the Matching Familiar Figures Test (MFF) and a newer instrument, the Multi-Choice Conceptual Tempo Apparatus (MCCTA). The MCCTA was more reliable and had stronger negative correlations between errors and latency than did the MFF. The MCCTA did not…

The idea that validity should be considered a property of inferences, rather than of assessments, has developed slowly over the past century. In early writings about the validity of educational assessments, validity was defined as a property of an assessment. The most common definition was that an assessment was valid to the extent that it…