This paper presents the development and initial validation of new measures of critical thinking and noncognitive attributes that were designed to supplement existing standardized tests used in the admissions system for higher education in Chile. The importance of various facets of this process, including the establishment of technical rigor and…

In this research investigation of score comparability for language minority students (English language learners [ELLs] and former English language learners), we examined 3 indicators of score comparability (reliability, internal test structure, and differential item functioning) for 4th and 8th grade students who took the NCLB-mandated content…

Political perspectives on the advisability of state achievement comparisons have changed substantially over the last half-century. As Selden (2004) noted regarding the National Assessment of Educational Progress (NAEP), "[w]hen it began in the 1960s, NAEP specifically was designed "not" to provide comparisons among states. This was…

Research studies have shown that a smaller percentage of students with learning disabilities participate in state assessments than do their peers without learning disabilities. Furthermore, there is almost always a performance gap between these groups of students on these assessments. It is important to evaluate whether a performance gap on a…

The equating process links scores from different editions of the same test. For testing programs that build nearly parallel forms to the same explicit content and statistical specifications and administer forms under the same conditions, the linkings between the forms are expected to be equatings. Score equity assessment (SEA) provides a useful…

This report evaluates the construct coverage of the e-rater[R[ scoring engine. The matter of construct coverage depends on whether one defines writing skill, in terms of process or product. Originally, the e-rater engine consisted of a large set of components with a proven ability to predict human holistic scores. By organizing these capabilities…

To many people, standardized testing means multiple-choice testing. However, some tests contain questions that require the test taker to produce the answer, rather than simply choosing it from a list. The required response can be as simple as the writing of a single word as complex as the design of a laboratory experiment to test a scientific…

This study examined math achievement of elementary school students when Math Out of the Box (MTB), an inquiry-based math program, was used to supplement curriculum. The sample consisted of 767 New Jersey students in the third, fourth, and fifth grades, with approximately one third using MTB. Math achievement was measured by an assessment…

Recently growth-based approaches to accountability have received considerable attention because they have the potential to reward schools and teachers for improving student performance over time by measuring the progress of students at all levels of the performance spectrum (including those who have not yet reached proficiency on state…

As college tuitions and fees continue to grow, students, parents and public policymakers are interested in understanding how public universities operate and whether their investments are well-utilized. Accountability in public higher education has come into focus following the attention accountability has received in K-12 education. Against this…

In 2006, Educational Testing Service (ETS) made a commitment to the higher education community to provide information that would help inform the national dialogue on accountability in higher education. This report "A Culture of Evidence: Critical Features of Assessments for Postsecondary Student Learning" (also referred to as "COE…

Annual standardized testing lies at the heart of the accountability system that American education reformers and policymakers have established during the past decade in an effort to ensure equal opportunity for all students, no matter their race, ethnicity or wealth. The new testing regime has brought national attention to the schooling of…

After a few decades of keeping a watchful eye, substantial gaps in the average standardized test scores of White and some minority group students persist. The average group differences on the SAT are among the most visible examples of this pattern, but when we focus only on mean score differences among students, we tend to overlook the relatively…