Techniques for quantifying the degree of fit between test items and curricula are classified according to the purposes of assessing: overall fit, fit of individual items to content domain, and the impact of test specifications on performance. Procedures for calculating each index and their properties are included. (SLD)

The comparability of Angoff-based item ratings on a general education test battery made by judges from within-content and across-content domains was studied. Results with 26 college faculty judges indicate that, at least for some tests, item ratings might be essentially equivalent regardless of judge's content specialty. (SLD)

This study shows that a placement test cannot only be examined for items that display differential item functioning (DIF) by using an item response theory, but also that the identification of potential sources for these DIF items can be attempted and short- and long-term measures to reduce DIF can then be proposed. (JL)

Reports that a goal and item analysis of eight history and systems of psychology textbooks and their accompanying test item files showed that the majority of the essay test items are too narrow in scope to measure the commonly stated course goals. Presents some integrative and goal-relevant essay questions to rectify this shortcoming. Includes a…

Compares two language tests with different item types. The tests are the Dutch Reynell test and the BELL test. Both tests were administered to 64 Dutch kindergarten children with an average age of 70.3 months. Regression analyses indicate that item type does not contribute significantly to prediction of item difficulty, but the linguistic…

In the Programme for International Student Assessment (PISA) the items are organised in small clusters relating to the same stimulus material (called 'units'). Homogeneity analysis (HA) is used to develop a detailed description of the relationship between all the items in one unit, using the categorical information available in the PISA data. The…

Women's autonomy has long been a central concern for researchers examining the social position of women in developing countries. However, little emphasis has been placed on the measurement of autonomy, despite its importance for assessing the validity of comparative research. In this research, we use confirmatory factor analyses to determine (1)…

Performance on a wide variety of memory tasks can be hypothesized to be influenced by processes associated with controlling the contents of memory. In this project 328 adults ranging from 18 to 93 years of age performed six tasks (e.g., multiple trial recall with an interpolated interference list, directed forgetting, proactive interference, and…

Eleven healthy men (M age = 27 years, SD = 4) completed three cycling and three walking trials in an alternating order. During each trial, participants were allowed, within 3 min, to adjust the work rate to correspond to given rating of perceived exertion (RPE) values according to the following order: RPE 11, 13, and 15. For cycling as well as…

A model of identity formation comprising four structural dimensions (Commitment Making, Identification with Commitment, Exploration in Depth, and Exploration in Breadth) was developed through confirmatory factor analysis. In a sample of 565 emerging adults, this model provided a better fit than did alternative two- and three-dimensional models,…

Not all policy questions can be addressed by social experiments. Nonexperimental evaluation methods provide an alternative to experimental designs but their results depend on untestable assumptions. This paper presents evidence on the reliability of propensity score matching (PSM), which estimates treatment effects under the assumption of…

In order to teach individuals with developmental disabilities to request stimuli they are motivated to obtain (mand), it is often necessary to initially deliver the item requested immediately and frequently. This may result in an undesirably high rate of mands that is impractical to maintain. The purpose of the current investigation was to extend…

This article presents a fluency-based measure of reading comprehension. A part of the Vitals Indicators of Progress (VIP) system, the measure outlined here represents an alternate form to the retell-fluency measure in the Dynamic Indicators of Basic Early Literacy System (DIBELS). Measures of retell fluency provide an efficient, fluency-based tool…

This study investigates the stability of differential item functioning (DIF) in survey data. Surveys are conducted periodically, and their results are often reported by aggregating responses. Estimating the stability of DIF across subsets of a survey population can be an important indicator in determining the likelihood of DIF stability over…

Differential item functioning (DIF) is an important consideration in assessing the validity of test scores (Camilli & Shepard, 1994). A variety of statistical procedures have been developed to assess DIF in tests of dichotomous (Hills, 1989; Millsap & Everson, 1993) and polytomous (Penfield & Lam, 2000; Potenza & Dorans, 1995) items. Some of these…