According to data from the National Assessment of Educational Progress, or NAEP, the U.S. educational system has consistently failed Black and Brown children across both reading and mathematics. Educational research has further uncovered the ways that reading and mathematics assessment and curriculum are often biased and culturally and…

Constructed response (CR) items are widely used in large-scale testing programs, including the National Assessment of Educational Progress (NAEP) and many district and state-level assessments in the United States. One unique feature of CR items is that they depend on human raters to assess the quality of examinees' work. The judgment of human…

The multidimensional item response theory (MIRT) models with covariates proposed by Haberman and implemented in the "mirt" program provide a flexible way to analyze data based on item response theory. In this report, we discuss applications of the MIRT models with covariates to longitudinal test data to measure skill differences at the…

Trend estimation in international comparative large-scale assessments relies on measurement invariance between countries. However, cross-national differential item functioning (DIF) has been repeatedly documented. We ran a simulation study using national item parameters, which required trends to be computed separately for each country, to compare…

This article presents the author's observations on Neil Dorans's NCME Career Award Address: "The Contestant Perspective on Taking Tests: Emanations from the Statue within." He calls attention to some points that Dr. Dorans made in his address, and offers his thoughts in response.

This pedagogical article is intended to explain the similarities and differences between the parameterizations of two multilevel measurement model (MMM) frameworks. The conventional two-level MMM that includes item indicators and models item scores (Level 1) clustered within examinees (Level 2) and the two-level cross-classified MMM (in which item…

At present, although the percentages of students with disabilities (SDs) and/or students who are English language learners (ELL) excluded from a NAEP administration are reported, no statistical adjustment is made for these excluded students in the calculation of NAEP results. However, the exclusion rates for both SD and ELL students vary…

When testing English language learners (ELLs) in subject matter areas, construct irrelevant variance could result from English, the language in which the test is presented. Differential item functioning (DIF) techniques have been used to determine if items are operating differently for population subgroups and might therefore be appropriate for…

"Classroom Assessment in Action" clarifies the multi-faceted roles of measurement and assessment and their applications in a classroom setting. Comprehensive in scope, Shermis and Di Vesta explain basic measurement concepts and show students how to interpret the results of standardized tests. From these basic concepts, the authors then…

The validity of current standardized competency tests for writing is in doubt as is the need for such testing at all. Some tests, especially those requiring little writing, may not be testing what they purport to test (content validity). Instructional validity (testing what has actually been taught) raises the issue that what is being tested is…

Abolishing standards underlying teacher competency testing to reverse bias against minorities actually results in lowered expectations and excuses poor performance. Rather, we should advocate educational progress for Black children at all educational levels. Better preparation of current students will eventually result in an improved and larger…

In recent years, the controversy surrounding testing has grown, and the charge of bias is the most often cited criticism of testing and assessment. A review of the literature indicates that psychometricians and other researchers speak of bias as a property of the test or of items in the test. Conversely, test critics speak of bias as a quality or…

The National Assessment of Educational Progress, in its power base, conception, creation, and execution, runs against the view that respects the local, unique culture as the prime determinant in education and supports the idea that education is an entity that a national program can clarify for delivery to children. (Author/IRT) Aspect of National…

The objections of testing experts to standardized testing are evaluated. The report begins with a foreword by Chester E. Finn, Jr., followed by an executive summary and an introduction. Four case studies include: (1) experts' opposition to high-stakes testing in Texas; (2) in North Carolina; (3) concerns raised in connection with the National…

It is suggested that some of the technology applied to state Scholastic Aptitude Test scores to measure states' educational performance (particularly use of a truncated Gaussian model) may make it possible to adjust National Assessment of Educational Progress (NAEP) scores to make inferences about state educational progress possible. (SLD)