Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

Researchers strategically assess youth mental health by soliciting reports from multiple informants. Typically, these informants (e.g., parents, teachers, youth themselves) vary in the social contexts where they observe youth. Decades of research reveal that the most common data conditions produced with this approach consist of discrepancies…

This study examined the convergent validity of the "Supports Intensity Scale-Adult Version" (SIS-A; Thompson et al., 2015a) and "Supports Intensity Scale-Children's Version" (SIS-C; Thompson et al., 2016a). Data from SISOnline (n = 129,864) for the SIS-A and from the SIS-C standardization sample (n = 4,015) were used for…

This study examined the convergent validity of the "Supports Intensity Scale-Adult Version" (SIS-A; Thompson et al., 2015a) and "Supports Intensity Scale-Children's Version" (SIS-C; Thompson et al., 2016a). Data from SISOnline (n = 129,864) for the SIS-A and from the SIS-C standardization sample (n = 4,015) were used for…

Beyond the traditional notions of intelligence and academic achievement, the successful development of noncognitive or "soft" skills (e.g., personality factors, motivation, creativity) among school-aged youth represents an important objective for any educational system. Such skills have been shown to be significantly predictive of…

The purpose of this study was to construct and validate a rating scale for collegiate wind jazz improvisation performance. The 14-item Wind Jazz Improvisation Evaluation Scale (WJIES) was constructed and refined through a facet-rational approach to scale development. Five wind jazz students and one professional jazz educator were asked to record…

We report the development of the Assessment of Individual Motives-Questionnaire (AIM-Q), a new instrument based on an evolutionary psychology theory of human motivation. It provides multitrait-multimethod (MTMM) assessment of individual differences on 15 motive scales. A total heterogeneous sample of N = 1,251 participated in eight studies that…

The present study investigated the factor structure of a field trial sample of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT). An item-level confirmatory factor analysis (CFA) was conducted for a polychoric correlation matrix of items on a test form completed by 2,720 participants in the 2003-2004 TOEFL iBT Field…

Used a multitrait-multimethod approach to investigate the validity of scores on locally prepared performance assessments taken by 6,000 third and fourth graders in reading, language arts, and mathematics. A partial explanation for the lack of construct validity evidence for the performance assessment scores is the probable low reliability of…

Extensions of the confirmatory factor analysis approach to multitrait-multimethod data are demonstrated, and self-other agreement on multiple dimensions of self-concept are evaluated in 2 studies investigating the ability of significant others to infer multiple dimensions of self-concept for 151 Australian and 941 Canadian college students. (SLD)

A validation study was conducted on the Child Sex Abuse Attitude Scale (CSAAS) using confirmatory factor analysis (CFA) to examine the factor structure of three comparative CFA models. Multitrait multimethod analysis was also used to examine the convergent and discriminant validity of the CSAAS. The instrument was developed based on the theory of…

This study used multiple methods to assess basic community needs and attributes of community atmosphere (cohesion, religious involvement, and recreational activities) in two psychometric studies. Part 1 revised self-report community assessment measures, developed multi-item scales for each construct, and tested reliabilities and factor structures…

This book presents a nontechnical, step-by-step process that shows how to evaluate any 360-degree-feedback instrument intended for management or leadership development. The 360-degree-feedback instruments collect information from different sources about a target manager's performance, and they offer multiple perspectives. The 16 steps in…

Equivalence in reliability and validity across 4-point and 6-point scales was assessed by fitting different measurement models through confirmatory factor analysis of a multitrait-multimethod covariance matrix. Responses to nine Likert-type items designed to measure perceived quantitative ability, self-perceived usefulness of quantitative…