When tests consist of multiple-choice and constructed-response items, researchers are confronted with the question of which item response theory (IRT) model combination will appropriately represent the data collected from these mixed-format tests. This simulation study examined the performance of six model selection criteria, including the…

Uses several thought experiments to explore the potential impact of the choice of criterion on the results of examinee-centered studies. Conclusions from these experiments are then used to examine the different cutting scores from several contrasting groups studies on the National Assessment of Educational Progress. (SLD)

Explains how schools and students are selected for the National Assessment of Educational Progress (NAEP) and why high participation rates are important. Describes the multistage sampling method, which allows the National Center for Education Statistics to give an accurate picture of student performance while keeping the burden on schools and…

If examinees are permitted to choose to answer a subset of the questions on a test, just knowing which questions were chosen can provide a measure of proficiency that may be as reliable as would have been obtained from the test graded traditionally. This new method of scoring is much less time consuming and expensive for both the examinee and the…

This paper proposes a new Information-Time index as the basis for item selection in computerized classification testing (CCT) and investigates how this new item selection algorithm can help improve test efficiency for item pools with mixed item types. It also investigates how practical constraints such as item exposure rate control, test…

Each year, the National Center for Education Statistics (NCES), asks thousands of schools and students to participate in the National Assessment of Educational Progress (NAEP). Their participation allows NCES to provide accurate information nationwide on how U.S. students perform in a variety of academic subjects. The NAEP uses a multistage…

Comparative results are presented for procedures recently appearing in literature related to standard setting on the National Assessment of Educational Progress--the paper selection method and the contrasting group method. For this comparison, a probabilistic model with normal distribution of performance and a six-point scale were assumed. The…

In June 1993 the "Wall Street Journal" carried a table of data prepared by the Heritage Foundation that listed the states in order of the average amount they expend on each public school student. The table also contained each state's rank on the average score on the Scholastic Aptitude Test (SAT) and the rank of each state in the average…

The research reported in this paper was conducted to gain information to guide the selection of standard setting procedures for use with polytomous items to set achievement levels on the National Assessment of Educational Progress (NAEP) assessments in U.S. History and geography. Standard-setting procedures were evaluated to determine the relative…

The National Assessment of Educational Progress (NAEP) is working to increase the numbers of students with disabilities (SD) or limited English proficient (LEP) students who are included in the assessment. Information is presented on the changes made to the inclusion criteria, the types of accommodations being offered, new procedures implemented…

This paper presents the appendices to the "High-Stakes Testing and Student Achievement: Problems for the No Child Left Behind Act" report. It contains the following appendices: (1) Example of Context for Assessing State-Level Stakes Sheet--Connecticut; (2) Example of Completed Rewards and Sanctions Worksheet--Connecticut; (3) Directions…