The Shedler-Westen Assessment Procedure (SWAP) is a personality assessment instrument designed for use by expert clinical assessors. Critics have raised questions about its psychometrics, most notably its validity across observers and situations, the impact of its fixed score distribution on research findings, and its test-retest reliability. We…

Multimethod data analysis is a complex procedure that is often used to examine the degree to which different measures of the same construct converge in the assessment of this construct. Several authors have called for a greater understanding of the definition and meaning of method effects in different models for multimethod data. In this article,…

The distinctiveness of physical aggression from other antisocial behavior is widely accepted but little research has explicitly focused on young children to empirically test this assumption. A Multitrait-Multimethod Matrix (MTMM) approach was employed to confirm the distinctiveness of physical aggression from nonaggressive antisocial behavior in…

Method effects often occur when constructs are measured by different methods. In traditional multitrait-multimethod (MTMM) models method effects are regarded as residuals, which implies a mean method effect of zero and no correlation between trait and method effects. Furthermore, in some recent MTMM models, traits are modeled to be specific to a…

Because research has shown that principals' practices can significantly impact teaching and learning in their schools through multiple avenues, it is critical to understand the validity of tools that measure principal practice. While the field has relied heavily on self-report surveys, little is known about their validity. This study compares…

One of the most consistent findings in rating scale research with children and adolescents is the modest agreement among different informants' ratings. The present study systematically explored patterns of agreement among teachers, parents/caregivers, and students in domains of social skills and problem behaviors using the Social Skills…

The Distress Disclosure Index (DDI; J. H. Kahn & R. M. Hessling, 2001) is a brief self-report measure of one's tendency to disclose personally distressing information. The purpose of this article was to summarize what is known about the DDI, present new validity evidence, and make recommendations for use of the DDI. This article reviews research…

The authors examined the dimensionality of the VARK learning styles inventory. The VARK measures four perceptual preferences: visual (V), aural (A), read/write (R), and kinesthetic (K). VARK questions can be viewed as testlets because respondents can select multiple items within a question. The correlations between items within testlets are a type…

In 2001, Elliot and McGregor proposed a 2 x 2 (mastery-performance x approach- avoidance) achievement goal frameworks and developed a questionnaire to measure four goals (mastery-approach, mastery-avoidance, performance-approach, and performance-avoidance goals). This study examines the dual meanings of items in 2 x 2 achievement goal…

The inclusion of self-directed projects as an element within a New Zealand principal development programme was designed to reflect increasing support internationally for such a context-specific "inquiry" approach. The results reported in this article suggest that considerable clarity is required for such projects if they are to realize…

Competency in the new literacies of the Internet is essential for participating in contemporary society. Researchers studying these new literacies are recognizing the limitations of traditional methodological tools and adapting new technologies and new media for use in research. This paper reports our exploration of usability testing software to…

This study examined how multiple measures can be used to study experienced teachers' learning. The study was conducted in an advanced Master's degree programme, aligned with the National Board for Professional Teaching Standards in the United States. The programmatic features and key learning experiences found in the programme are described and…

Instrument choice is a crucial part of evaluation of professional development programmes. The use of multiple evaluation methods helps in triangulation, and offers insight into the developmental sequence involved in the changes in teacher beliefs and practice. Most current instruments are self-contained and not designed for use in conjunction with…

The authors show how structural equation modeling can be applied to analyze change in longitudinal multitrait-multimethod (MTMM) studies. For this purpose, an extension of latent difference models (McArdle, 1988; Steyer, Eid, & Schwenkmezger, 1997) to multiple constructs and multiple methods is presented. The model allows investigators to separate…

This article examines 4 approaches for explaining shared method variance, each applied to a longitudinal trait-state-occasion (TSO) model. Many approaches have been developed to account for shared method variance in multitrait-multimethod (MTMM) data. Some of these MTMM approaches (correlated method, orthogonal method, correlated method minus one,…