The purpose of this article was two-fold (1) provide an overview of the commonly reported and under-reported absolute agreement indices in the kinesiology literature for continuous data; and (2) present examples of these indices for hypothetical data along with recommendations for future use. It is recommended that three types of information be…

This study defines subpopulation item parameter drift (SIPD) as a change in item parameters over time that is dependent on subpopulations of examinees, and hypothesizes that the presence of SIPD in anchor items is associated with bias and/or lack of invariance in three psychometric outcomes. Results show that SIPD in anchor items is associated…

The purpose of this study was to examine the impact of dimensionality, common-item set format, and different scale linking methods on preserving equity property with mixed-format test equating. Item response theory (IRT) true-score equating (TSE) and IRT observed-score equating (OSE) methods were used under common-item nonequivalent groups design.…

Modeling multidimensional test data with a unidimensional model can result in serious statistical errors, such as bias in item parameter estimates. Many methods exist for assessing the dimensionality of a test. The current study focused on DIMTEST. Using simulated data, the effects of sample size splitting for use with the ATFIND procedure for…

It is often assumed that a vertical scale is necessary when value-added models depend upon the gain scores of students across two or more points in time. This article examines the conditions under which the scale transformations associated with the vertical scaling process would be expected to have a significant impact on normative interpretations…

The process of constructing assessment scales for performance testing is complex and multi-dimensional. As a result, a number of different approaches, both empirically and intuitively based, are open to developers. In this paper we outline the approach taken in the revision of a set of assessment scales used with speaking tests, and present the…

Goal attainment scaling (GAS) has been considered to be one of the most versatile and appealing evaluation protocols available for human services. Aspects of the protocol that make the method so appealing to practitioners--that is, collaboratively working with individual clients to identify and assign weights to goals they will work to…

This study determined through psychophysical comparison of scaling data that speech naturalness judgments of stutterers and nonstutterers from audiovisual recordings form a metathetic (or qualitative) rather than prothetic (or quantitative) continuum. Both direct magnitude estimation and equal-appearing interval scaling were valid, but interval…

Although there are many methods available for dimensionality assessment for items with monotone item response functions, there are few methods available for unfolding item response theory models. In this study, a modification of Yen's Q3 statistic is proposed for the case of these nonmonotone item response models. Through a simulation study, the…

In this paper I describe and illustrate the Roussos-Stout (1996) multidimensionality-based DIF analysis paradigm, with emphasis on its implication for the selection of a matching and studied subtest for DIF analyses. Standard DIF practice encourages an exploratory search for matching subtest items based on purely statistical criteria, such as a…

The present study examined three different methods of data collection in which subjects judged proximity between object pairs. One method required subjects to partition objects into homogeneous subsets; the second entailed rating object pairs on a similarity-dissimilarity continuum; and the third involved comparing inter-object proximities to a…

The use of evaluation information in a large state agency was investigated through a case study approach. Utilization was measured through a scaling procedure considering the status of recommendations within a report and the extent of influence of the evaluation of the status. The scaling procedure, the equal-appearing interval method, used…

A scaling technique known as the Method of Reciprocal Averages has been in use since the early 1930's. This technique yields a set of item response weights for a psychological inventory which maximizes the internal consistency of the inventory for a group of subjects. Although the technique has been used for many years, its mathematical…

Discusses the different strategies employed by three practical nonmetric multidimensional scaling algorithms using Monte Carlo techniques. (Author/RK)

A sample of 234 fifth- and 259 sixth-grade students scaled the items of the Piers-Harris, Tennessee, Coopersmith, and Lipsett self-concept measures. The scaling of the Piers-Harris and the Tennessee inventories was examined in reference to their subscales. The present technique placed items on a bivariate plane of two orthogonal dimensions…