This is the fifth annual edition of the Brown Center Report on American Education. It analyzes the difficulty of items on the math portion of the National Assessment of Educational Progress (NAEP), examines the content training of middle school math teachers, and evaluates the Blue Ribbon Schools Program. The NAEP assesses student performance…

A study was conducted to compare the psychometric qualities of two forms of an identical survey: one administered in a paper-and-pencil format and the other administered in Web format. The survey addressed the topic of college course anxiety and used to survey a sample of 236 undergraduate students. The psychometric qualities investigated included…

Given current high-stakes uses of tests, one of the most pressing and difficult problems confronting the field of measurement is to develop better methods for distinguishing between meaningful gains in performance and score inflation. This study explores the potential usefulness of adapting differential item functioning (DIF) techniques for this…

A group of fourth-grade students with disabilities participating in statewide mathematics assessments in the spring of 2001 (n=570) was given a new assessment focused on specifically modified state curricular standards defined for students with disabilities. A block of items from that assessment was also given to students taking the general…

This booklet is an explanation of what the Alaska High School Graduation Qualifying Examination means to Alaskans and how it fits into a larger school accountability reform initiative. The high school class of 2002 is the first group of students who will need to pass the High School Graduation Qualifying Examination to receive a high school…

The Rasch Model is an item response theory, one parameter model developed that states that the probability of a correct response is a function of the difficulty of the item and the ability of the candidate. Item banking is useful for language testing. The Rasch Model provides estimates of item difficulties that are meaningful, irrespective of…

Multidimensionality is known to affect the accuracy of item parameter and ability estimations, which subsequently influences the computation of item characteristic curves (ICCs) and true scores. By judiciously combining sections of a Law School Admission Test (LSAT), 11 sections of varying degrees of uni- and multidimensional structures are used…

Person-fit statistics have been proposed to investigate the fit of an item score pattern to an item response theory (IRT) model. This study investigated how these statistics can be used to detect different types of misfit. Intelligence test data for 992 people at or beyond college level were analyzed using person-fit statistics in the context of…

The purpose of this simulation was to assess the improvements in estimates of standard errors that could be expected if students participating in NAEP were pre-assigned to test booklets that were adapted to their level of performance based on their state assessment scores. Students in extreme quartiles would receive one regular NAEP block and…

For the past two years, Achieve, Inc. has worked with the Transition Mathematics Project (TMP), a collaborative project of K-12 schools, community and technical colleges, and baccalaureate institutions within the state of Washington, as it developed mathematics standards that "define the core knowledge and skills expected of students entering…

In 1998 and again in 2002, samples of eighth grade students in California were tested in reading as part of the state-level component of the National Assessment of Educational Progress (NAEP). In each of these years, all eighth graders in the state were also required to participate in the state's accountability testing, which included the reading…

Twenty-four Piagetian-based written items representing different forms (stages) of thought and different logical operations were solved by 553 participants from required introductory logic classes in a state university in a medium-sized midwestern city and from a suburban school district of that city. Responses to each item were scored by quality…

This handbook provides information for persons who are preparing to take a test for certification in the plastics industry. The nine sections of the handbook provide information on the following: (1) the mission of the Society of the Plastics Industry and the value of the National Certification in Plastics; (2) tips on preparing for the exam; (3)…

Large-scale testing is dominated by the multiple-choice question format. Widespread use of the format is due, in part, to the ease with which multiple-choice items can be scored automatically. This paper examines automatic scoring procedures for an alternative item type: figural response. Figural response items call for the completion or…

This paper describes findings from two studies involving optional use of calculators on Scholastic Aptitude Test (SAT) mathematical items. The first study looked at the effects of calculator use on estimates of item difficulty. The second study looked at the effect of calculator use on equating results from an anchor test design. Study 1,…