NotesFAQContact Us
Collection
Advanced
Search Tips
Showing all 7 results Save | Export
Using Multilabel Neural Network to Score High-Dimensional Assessments for Different Use Foci: An Example with College Major Preference Assessment
Peer reviewed Peer reviewed
Direct linkDirect link
Shun-Fu Hu; Amery D. Wu; Jake Stone – Journal of Educational Measurement, 2025
Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…
Descriptors: Tests, Testing, Scores, Test Construction
The Operations Triad Model and Youth Mental Health Assessments: Catalyzing a Paradigm Shift in Measurement Validation
Peer reviewed Peer reviewed
PDF on ERIC Download full text
Direct linkDirect link
Andres De Los Reyes; Mo Wang; Matthew D. Lerner; Bridget A. Makol; Olivia M. Fitzpatrick; John R. Weisz – Grantee Submission, 2022
Researchers strategically assess youth mental health by soliciting reports from multiple informants. Typically, these informants (e.g., parents, teachers, youth themselves) vary in the social contexts where they observe youth. Decades of research reveal that the most common data conditions produced with this approach consist of discrepancies…
Descriptors: Mental Health, Measurement Techniques, Evaluation Methods, Research
Construct Validation of the "Supports Intensity Scale--Children and Adult Versions": An Application of a Pseudo Multitrait-Multimethod Approach
Peer reviewed Peer reviewed
Direct linkDirect link
Seo, Hyojeong; Shogren, Karrie A.; Little, Todd D.; Thompson, James R.; Wehmeyer, Michael L. – American Journal on Intellectual and Developmental Disabilities, 2016
This study examined the convergent validity of the "Supports Intensity Scale-Adult Version" (SIS-A; Thompson et al., 2015a) and "Supports Intensity Scale-Children's Version" (SIS-C; Thompson et al., 2016a). Data from SISOnline (n = 129,864) for the SIS-A and from the SIS-C standardization sample (n = 4,015) were used for…
Descriptors: Test Construction, Test Validity, Adults, Children
Construct Validation of the "Supports Intensity Scale-Children" and "Adult" Versions: An Application of a Pseudo Multitrait-Multimethod Approach
Peer reviewed Peer reviewed
PDF on ERIC Download full text
Direct linkDirect link
Seo, Hyojeong; Shogren, Karrie A.; Little, Todd D.; Thompson, James R.; Wehmeyer, Michael L. – Grantee Submission, 2016
This study examined the convergent validity of the "Supports Intensity Scale-Adult Version" (SIS-A; Thompson et al., 2015a) and "Supports Intensity Scale-Children's Version" (SIS-C; Thompson et al., 2016a). Data from SISOnline (n = 129,864) for the SIS-A and from the SIS-C standardization sample (n = 4,015) were used for…
Descriptors: Adults, Children, Disabilities, Multitrait Multimethod Techniques
Measuring Motivation Multidimensionally: Development of the Assessment of Individual Motives-Questionnaire (AIM-Q)
Peer reviewed Peer reviewed
Direct linkDirect link
Bernard, Larry C.; Mills, Michael; Swenson, Leland; Walsh, R. Patricia – Assessment, 2008
We report the development of the Assessment of Individual Motives-Questionnaire (AIM-Q), a new instrument based on an evolutionary psychology theory of human motivation. It provides multitrait-multimethod (MTMM) assessment of individual differences on 15 motive scales. A total heterogeneous sample of N = 1,251 participated in eight studies that…
Descriptors: Test Construction, Questionnaires, Test Reliability, Multitrait Multimethod Techniques
Choosing 360. A Guide to Evaluating Multi-Rater Feedback Instruments for Management Development.
Van Velsor, Ellen; Leslie, Jean Brittain; Fleenor, John W. – 1997
This book presents a nontechnical, step-by-step process that shows how to evaluate any 360-degree-feedback instrument intended for management or leadership development. The 360-degree-feedback instruments collect information from different sources about a target manager's performance, and they offer multiple perspectives. The 16 steps in…
Descriptors: Administrator Characteristics, Evaluation Methods, Feedback, Interrater Reliability
Using Confirmatory Factor Analysis of Multitrait-Multimethod Data To Assess the Psychometrical Equivalence of 4-Point and 6-Point Likert-Type Scales.
PDF on ERIC Download full text
Chang, Lei – 1993
Equivalence in reliability and validity across 4-point and 6-point scales was assessed by fitting different measurement models through confirmatory factor analysis of a multitrait-multimethod covariance matrix. Responses to nine Likert-type items designed to measure perceived quantitative ability, self-perceived usefulness of quantitative…
Descriptors: Ability, Comparative Testing, Education Majors, Graduate Students