Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

As the field of higher education has used several methods to assess college teaching, the validation of these measures and how they relate to each other has been sparse. This study drew on data from a multi-institutional study of 587 college courses to examine the efficacy of two methods of measuring college teaching (class observation and…

The reliability and validity of course grades as measures of general education learning outcomes were assessed using the multitrait-multimethod (MTMM) proposed by Campbell and Fiske. Convergent validity and discriminant validity were assessed on college undergraduate students over a 12-year period. Two procedures were used to test the MTMM. The…

Practitioners and researchers interested in understanding student achievement, its predictors, and how it relates to other student outcomes are likely unaware of how the source information about achievement may offer subtly different pictures. This study applies multitrait-multimethod (MTMM) confirmatory factor analysis (CFA) within a structural…

The "Kobayashi Maru" is a training simulation that has its roots in the Star Trek series notable for its defining characteristic as a no-win scenario with no "correct" resolution and where the solution actually involves redefining the problem. Drawing upon these characteristics, we designed a board meeting simulation for an…

Cultural differences between faculty and their students can create important challenges that affect the quality and efficacy of online teaching and learning. The objectives of this study were to: (a) create and pilot test an assessment for online faculty to measure culturally responsive teaching knowledge (CRT) and culturally responsive…

Estimation problems associated with the correlated-trait correlated-method (CTCM) parameterization of a multitrait-multimethod (MTMM) matrix are widely documented: the model often fails to converge; even when convergence is achieved, one or more of the parameter estimates are outside the admissible parameter space. In this study, the authors…

We investigated the relationship between parent support and peer support as predictors of depression and self-esteem in college students. Several competing models of parental and peer influence were compared including a mediational model in which peer support was hypothesized to mediate the effects of parental support on adjustment. The results…

Three approaches of validation enquiry were applied on the data obtained from a proficiency test carried out with 3,398 PhD candidates as a partial requirement for entering PhD program in Iran. The data obtained from the reading section were subjected to an exploratory factor analysis (EFA). The EFA yielded nine factors in the reading section.…

This study assessed trait validity of the Reynolds Intellectual Assessment Scales' (RIAS) Verbal Index (VIX) and Nonverbal Index (NIX) scores in a group of college students. Using both observation of patterns and latent variable modeling of a multitrait-multimethod correlation/covariance matrix, the results indicate that the RIAS VIX scores…

A major stumbling block for emotional intelligence (EI) research has been the lack of adequate evidence for discriminant validity. In a sample of 280 dyads, self- and peer-reports of EI and Big Five personality traits were used to confirm an a priori four-factor model for the Wong and Law Emotional Intelligence Scale (WLEIS) and a five-factor…

The purpose of this study was to construct and validate a rating scale for collegiate wind jazz improvisation performance. The 14-item Wind Jazz Improvisation Evaluation Scale (WJIES) was constructed and refined through a facet-rational approach to scale development. Five wind jazz students and one professional jazz educator were asked to record…

Primary health care nurses are frequently overlooked when delivering services to children with developmental disabilities, despite the fact that they are often the first contact many primary caregivers have with rehabilitation professionals and usually remain the bridge between caregivers and professionals. A time series one group design with…

The computing learning environment has not often been equitable for female students. For example, the number of females enrolled in tertiary computing courses is low compared with males and their retention is poor. In recent years, New Zealand educational institutions have experienced an increased enrolment of "new arrivals"--students of…