Compared different models suggested for the analysis of multitrait multimethod (MTMM) experiments for their fit to 87 data sets collected in the United States. The fit of models based on polychoric correlations is much worse than the fit of models based on product moment correlations, but in both cases a model that assumes additive method effects…

Approaches to the evaluation of multitrait-multimethod data in which there are multiple indicators of each trait-method combination are explored. A first-order factor defined by multiple indicators is posited for each trait-method combination, and method and trait factors are posited as second-order factors. (SLD)

We report the development of the Assessment of Individual Motives-Questionnaire (AIM-Q), a new instrument based on an evolutionary psychology theory of human motivation. It provides multitrait-multimethod (MTMM) assessment of individual differences on 15 motive scales. A total heterogeneous sample of N = 1,251 participated in eight studies that…

Purpose: The purpose of this paper is to show that most small business owner-managers are technically competent in their area of business activity however they do not always have equal managerial competence. For example, deficiency in human resource management competence may lead to difficulties in attracting, retaining or leading staff. These…

A study was conducted comparing the feedback received from students about teaching obtained using different instruments. Twelve first- and second-year undergraduate modules were selected from seven different schools within a single university. Students studying each module were allocated to "questionnaire" and "comparator" groups. "Questionnaire"…

The authors report relations between entrance criteria and study success in a program for a master of science in business. Based on the admission criteria broadly used in European business schools and the findings of prior research, the present authors measured eight criteria for study success in the master's degree program. The authors applied…

This article proposes a multilevel modeling approach to study the general and specific attitudes formed in human learning behavior. Based on the premises of activity theory, it conceptualizes the unit of analysis for attitude measurement as a scalable and evolving activity system rather than a single action. Measurement issues related to this…

The validity of the Treatment Motivation Scales for outpatient offender treatment (TMS-F), a self-report questionnaire with scales for the motivation of patients to engage in the treatment and six cognitive and emotional determinants of this motivation, is evaluated in two studies. In Study 1 (N = 620), the "construct validity" of the…

The intersection of mixed methods and social justice has implications for the role of the researcher and choices of specific paradigmatic perspectives. The transformative paradigm with its associated philosophical assumptions provides a framework for addressing inequality and injustice in society using culturally competent, mixed methods…

A mixed methods study has the potential to produce knowledge that is unavailable to a qualitative study and a quantitative study undertaken independently. Any unique insight or "yield" from a mixed methods study may be difficult to assess in practice. However, given that integration of data or findings from different components of a…

This study investigated the convergent and discriminant validity of the high-stakes Florida Comprehensive Assessment Test (FCAT) in both reading and writing at grade levels 4, 8, and 10. The data from the 2006 FCAT administration were analyzed via traditional multitrait-multimethod (MTMM) analysis to identify the factor structure and structural…

Presents a quick distribution-free test that contributes evidence of construct validity from the Multitrait-Multimethod Matrix. The procedure is carried by reducing the heterotrait-heteromethod and heterotrait-monomethod triangles and the validity and reliability diagonals into a matrix of four levels. The null hypothesis states that the values…

Assessed two models for confirmatory factor analysis of multitrait-multimethod data through Monte Carlo simulation. The correlated traits-correlated methods (CTCM) and the correlated traits-correlated uniqueness (CTCU) models were compared. Results suggest that CTCU is a good alternative to CTCM in the typical multitrait-multimethod matrix, but…

Psychologists interviewed direct-care staff using a battery of assessment measures including the autism spectrum disorders-diagnosis for intellectually disabled adults (ASD-DA), the Diagnostic Assessment for the Severely Handicapped-II (DASH-II), the Matson Evaluation of Social Skills for Individuals with Severe Retardation (MESSIER), the…

This article explores the statistical methodologies used in demonstration and effectiveness studies when the treatments are applied across multiple settings. The importance of evaluating and how to evaluate these types of studies are discussed. As an alternative to standard methodology, the authors of this article offer an empirical binomial…