Goal attainment scaling (GAS) is an internationally recognized measure that is widely used in educational, counseling, and clinical settings to identify and evaluate relevant goals for an individual. The GAS is an unusual measure because its content, which consists of goals, is formed by the respondent and/or users in the process of completing the…

Methods to generate random correlation matrices have been proposed in the literature, but very few instances exist where these correlation matrices are structured or where the statistical properties of the algorithms are known. By relying on the tetrad relation discovered by Spearman and the properties of the beta distribution, an algorithm is…

This study introduces a novel differential item functioning (DIF) method based on propensity score matching that tackles two challenges in analyzing performance assessment data, that is, continuous task scores and lack of a reliable internal variable as a proxy for ability or aptitude. The proposed DIF method consists of two main stages. First,…

Ultimately, measures in research, testing, assessment and evaluation are used, or have implications, for ranking, intervention, feedback, decision-making or policy purposes. Explicit recognition of this fact brings the often-ignored and sometimes maligned concept of consequences to the fore. Given that measures have personal and social…

This article describes a method based on Pratt's measures and demonstrates its use in exploratory factor analyses. The article discusses the interpretational complexities due to factor correlations and how Pratt's measures resolve these interpretational problems. Two real data examples demonstrate the calculation of what we call the…

A variety of differential item functioning (DIF) methods have been proposed and used for ensuring that a test is fair to all test takers in a target population in the situations of, for example, a test being translated to other languages. However, once a method flags an item as DIF, it is difficult to conclude that the grouping variable (e.g.,…

There is a lack of research on the effects of outliers on the decisions about the number of factors to retain in an exploratory factor analysis, especially for outliers arising from unintended and unknowingly included subpopulations. The purpose of the present research was to investigate how outliers from an unintended and unknowingly included…

The researchers examined if scores from the original Psychological Need Satisfaction in Exercise Scale (Wilson, Rogers, Rodgers, & Wild, 2006) were invariant from a modified version specific to physical activity and then examined measurement invariance of scores across groups on the modified scale. Three groups were examined: (a) Students/staff…

International large-scale assessments of achievement often have a large degree of differential item functioning (DIF) between countries, which can threaten score equivalence and reduce the validity of inferences based on comparisons of group performances. It is important to understand potential sources of DIF to improve the validity of future…

Whenever one uses a composite scale score from item responses, one is tacitly assuming that the scale is dominantly unidimensional. Investigating the unidimensionality of item response data is an essential component of construct validity. Yet, there is no universally accepted technique or set of rules to determine the number of factors to retain…

A case is made that measures used in quality of life and happiness research will be essentially unidimensional: inherently tapping minor dimensions. This is illustrated using Diener's Satisfaction with Life Scale (SWLS). It is shown that the SWLS does not meet the standard of strict unidimensionality, but that the interpretation of the total scale…

The present study explored the short-term temporal characteristics of subjective well-being (SWB) and its potential correlates. Specifically, we examined the intra-individual variability and the trajectories of SWB and its components life satisfaction, positive, and negative affect. Over a two-week period, 27 participants (78% university students,…

One theoretical feature that makes item response theory (IRT) models those of choice for many psychometric data analysts is parameter invariance, the equality of item and examinee parameters from different examinee populations or measurement conditions. In this article, using the well-known fact that item and examinee parameters are identical only…

The present study evaluated subjective importance weighting using data collected with the Injection Drug User Quality of Life Scale (IDUQOL). Weighted and unweighted IDUQOL scores from 241 adults were correlated with convergent, discriminant, and criterion measures. Regression analysis was used to examine the contribution of importance ratings to…