Purpose: Scholars who advocate for equity-oriented educational practices have argued that the accountability era in the USA, now in place for two decades, has failed in its intended goal to improve student performance for traditionally marginalized student populations. This study aims to use a sociocultural lens to trace how a century-old…

Scores on essay-based assessments that are part of standardized admissions tests are typically given relatively little weight in admissions decisions compared to the weight given to scores from multiple-choice assessments. Evidence is presented to suggest that more weight should be given to these assessments. The reliability of the writing scores…

In this technical report, we present the results of a reliability study of the second-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

The No Child Left Behind (NCLB) legislation spawned a plethora of standardized testing services for all the high stakes testing required by the law. We argue that one-size-fits all assessments disadvantage students who are English Language Learners, in the USA, as well as students with limited economic resources, special needs, and not reading on…

In this technical report, we present the results of a reliability study of the seventh-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

The authors are professors of literacy in a teacher education program that leads to a reading endorsement. Their graduates are reading specialists, literacy coaches, and district language arts specialists--but only if, in addition to the coursework and practicum experience that make up their National Council for Accreditation of Teacher Education…

The purpose of this article is to illustrate a seven-step process for determining whether inferential reading items were more susceptible to cultural bias than literal reading items. The seven-step process was demonstrated using multiple-choice data from the reading portion of a reading/language arts test for fifth and seventh grade Hispanic,…

Stereotype threat research has demonstrated how presenting situational cues in a testing environment, such as raising the salience of negative stereotypes, can adversely affect test performance (Perry, Steele, & Hilliard, 2003; Steele & Aronson, 1995) and expectancy (Cadinu, Maass, Frigerio, Impagliazzo, & Latinotti, 2003; Stangor,…

This article explores the reasoning employed by high school students to answer a set of multiple-choice history questions. The questions come from New York State's Global History and Geography Regents exam. The Regents exams, together with a particularly well-regarded and ambitious set of content standards, are the cornerstone of the state's…

The present study provides an overview of the impact of standardized EFL tests on EFL education in Korea. To achieve this goal, the paper (1) presents the status quo of EFL testing in the Korean context, (2) explores the nature of the EFL tests prevalent in the EFL testing market, and (3) investigates the overwhelming washback effects of EFL tests…

Presuming that test scores can accurately reflect educational quality is naive and potentially dangerous. Sophisticated statistical procedures cannot fully separate the effects of confounding background variables (ethnicity, language proficiency, or poverty) from test scores. A broad-based assessment model relying on multiple indices and…

For 50 years, large-scale educational achievement testing in the United States was dominated by a (low-cost) multiple-choice assessment strategy. The problem is finding adequate financial resources to support constructed-response methods used in authentic or performance testing. Matrix sampling, featuring low-proportion sampling of both students…

A framework for categorizing constructed-response items was developed in which items were ordered on a continuum from multiple-choice to presentation/performance according to the degree of constraint placed on the examinee's response. Two investigations were carried out to evaluate the validity of this framework. In the first investigation, 27…

Although a constructivist approach to learning calls into question the adequacy of norm-referenced, multiple-choice tests, these tests will persist into the 21st century. This article describes a classroom-based study that helped collaboratively oriented fifth graders develop problem-solving strategies to select answers to test questions. This…

Kentucky is reintroducing the norm-referenced, multiple-choice test. Students will be given both performance and multiple-choice tests, beginning in spring 1997. Kean believes this multiple-measures approach is a common-sense way to provide the measurement-driven accountability that most states require. Neill deplores multiple-choice testing and…