This paper makes an in-depth comparison of the PISA (OECD) and TIMSS (IEA) mathematics assessments conducted in 2003. First, a comparison of survey methodologies is presented, followed by an examination of the mathematics frameworks in the two studies. The methodologies and the frameworks in the two studies form the basis for providing…

Dodeen (2004) studied the correlation between the item parameters of the three-parameter logistic model and two item fit statistics, and found some linear relationships (e.g., a positive correlation between item discrimination parameters and item fit statistics) that have the potential for influencing the work of practitioners who employ item…

This study explored the use of kernel equating for integrating and extending two procedures proposed for assessing item order effects in test forms that have been administered to randomly equivalent groups. When these procedures are used together, they can provide complementary information about the extent to which item order effects impact test…

This article introduces a multinomial error model, which models an examinee's test scores obtained over repeated measurements of an assessment that consists of polytomously scored items. A compound multinomial error model is also introduced for situations in which items are stratified according to content categories and/or prespecified numbers of…

One classroom using two units from a "Standards"-based curriculum was the focus of a study designed to examine the effects of real-world contexts, delays in the introduction of formal mathematics terminology, and multiple function representations on student understanding. Students developed their own terminology for y-intercept, which was tightly…

Retrieval practice with particular items from memory can impair the recall of related items on a later memory test. This retrieval-induced forgetting effect has been ascribed to inhibitory processes (M. C. Anderson & B. A. Spellman, 1995). A critical finding that distinguishes inhibitory from interference explanations is that forgetting is found…

We use clustering, an analysis method not presently common to the physics education research community, to group and characterize student responses to written questions about two-dimensional kinematics. Previously, clustering has been used to analyze multiple-choice data; we analyze free-response data that includes both sketches of vectors and…

This state-of-the-art review describes the genesis, structure, methods, applications, limitations and goals of the ordering analytic approach to hierarchical analysis, with specific reference to its relevance and use in educational, psychology and behavioral sciences. Hierarchy is defined as an "ordering" of objects such that the…

This paper compares two methods of estimating component difficulties for dichotomous test data. Simulated data are used to study the effects of sample size, collinearity, a measurement disturbance, and multidimensionality on the estimation of component difficulties. (RB)

This study explored the dangers of item theft in terms of impact on test quality and fairness. Simulations were used to explore the impact of item theft on test taker scores. In the simulation, a simulated, organized group of thieves took the test, memorized the items received, and distributed the items to future test takers. Impact was explored…

The purpose of this study was to assess the dimensionality of attitudinal data arising from unfolding models for discrete data and to compute rough estimates of item and individual parameters for use as starting values in other estimation parameters. One- and two-dimensional simulated test data were analyzed in this study. Results of limited…

The four items on the scale that favored the Down syndrome Ss all involved figural content and visual-motor ability. The five items that favored the non-Down syndrome Ss generally involved semantic content, social intelligence, general comprehension, and/or judgment and reasoning. (Author/SB)

Presents three components of the tests with instructional feedback on slides system (TIFS), the needs of the three, background on the production of the test item reference card, and the advantage of the system for both instructor and student. (MER)

Explains different ways to use National Assessment of Educational Progress (NAEP) test items for classroom assessment. Presents examples from 4th grade questions. (SOE)

A formally simple expression for the maximal reliability of a linear composite is provided. Its theoretical implications and its relation to existing results for reliability are discussed. (Author/SLD)