The Shedler-Westen Assessment Procedure (SWAP) is a personality assessment instrument designed for use by expert clinical assessors. Critics have raised questions about its psychometrics, most notably its validity across observers and situations, the impact of its fixed score distribution on research findings, and its test-retest reliability. We…

The distinctiveness of physical aggression from other antisocial behavior is widely accepted but little research has explicitly focused on young children to empirically test this assumption. A Multitrait-Multimethod Matrix (MTMM) approach was employed to confirm the distinctiveness of physical aggression from nonaggressive antisocial behavior in…

The validity of the Treatment Motivation Scales for outpatient offender treatment (TMS-F), a self-report questionnaire with scales for the motivation of patients to engage in the treatment and six cognitive and emotional determinants of this motivation, is evaluated in two studies. In Study 1 (N = 620), the "construct validity" of the…

In this article we examine empirical evidence on the criterion, predictive, transfer, and fairness aspects of validity of a large-scale language arts performance assessment, referred to as the Performance Assignment (PA). We use multilevel models to avoid biased inferences that might result from the naturally nested data. Specifically, we examine…

A large number of previous studies have used self-construal to predict communication outcomes. Recent evidence, however, suggests that validity problems may exist in self-construal measurement. The current study conducted a multimethod multitrait (Campbell & Fiske, 1959) validation study of self-construal measures with data (total N = 578)…

This study compared four methods for setting item response time thresholds to differentiate rapid-guessing behavior from solution behavior. Thresholds were either (a) common for all test items, (b) based on item surface features such as the amount of reading required, (c) based on visually inspecting response time frequency distributions, or (d)…

This study examined the factor structure of the parent and teacher versions of the Strengths and Difficulties Questionnaire (SDQ; R. Goodman, 1997) with a sample of first-grade children at risk for educational failure. The 5-factor model previously found in studies using exploratory factor analysis was fit to the data for both parent and teacher…

Common approaches to examining the relationship between multitrait-multimethod (MTMM) data and variables outside the MTMM data are compared: averaging various means of each trait and estimating LISREL computer program models, and estimating only relationships between MTMM traits and the outside variables. Problems of correlational bias are…

Researchers sometimes need a statistical test of the hypothesis that two values of Cronbach's alpha reliability coefficient are equal. The situation may involve scores from two different measures administered to independent random samples or from the same measure administered to random samples from two different populations. Feldt derived a test…

To examine the utility of a self-report scale of sexual assault trauma, 223 female victims were interviewed with the 43-item Sexual Assault Symptom Scale II (SASS II) at 1, 3, 7, 11, and 15 months postassault. Factor analyses using principal-components extraction with an oblimin rotation yielded 7 common factors with 31 items. The internal…

The Learning Accomplishment Profile-Diagnostic Edition and Vineland Adaptive Behavior Scales were subjected to multitrait-multimethod analysis with 40 randomly selected preschoolers. Difficulties in the areas of convergent validity and profile interpretations of functioning were found. (TJH)

This study investigated construct validity and factorial invariance of a performance assessment of reading comprehension and writing proficiency through a multitrait-multimethod (MTMM) structure using confirmatory factor analysis. The performance assessment was administered to 1,023 fifth and sixth graders. Interrater reliability was examined for…