Scoring high-dimensional assessments (e.g., > 15 traits) can be a challenging task. This paper introduces the multilabel neural network (MNN) as a scoring method for high-dimensional assessments. Additionally, it demonstrates how MNN can score the same test responses to maximize different performance metrics, such as accuracy, recall, or…

Triangulation -- a combined use of different assessment methods or sources to evaluate psychological constructs -- is still a rarely used assessment approach in spite of its potential in overcoming inherent constraints of individual assessment methods. This paper uses field test data from a new OECD Study on Social and Emotional Skills to examine…

We propose, develop, and evaluate the black ink-red ink (BIRI) method of testing. This approach uses two different methods within the same test administration setting, one that matches recognition learning and the other that matches recall learning. Students purposively define their own tradeoff between the two approaches. Evaluation of the method…

How can assessments measure complex science learning? Although traditional, multiple-choice items can effectively measure declarative knowledge such as scientific facts or definitions, they are considered less well suited for providing evidence of science inquiry practices such as making observations or designing and conducting investigations.…

Two studies extended psychometric research on the Student-Teacher Relationship Scale (STRS) with kindergarten and preschool children (N[subscript 1] = 60-7[subscript 1]; N[subscript 2] = 35) and their teachers. These studies used a multi-method approach to replicate and extend previous findings concerning the convergent validity of the STRS…

This article examines the psychometric structure of the Anxiety Control Questionnaire (ACQ) in Chinese adolescents. With the data collected from 212 senior high school students (94 females, 110 males, 8 unknown), seven models are tested using confirmatory factor analyses in the framework of the multitrait-multimethod strategy. Results indicate…

This study was undertaken to determine whether an evaluation model employing multiple methods of data collection and analysis might yield more useful information for improving lifelong learning courses than existing models. Major findings included: (1) learning satisfaction appears to be dependent on the instructional environment adults may be…

An application of confirmatory factor analysis, using the LISREL program, to retrospective analysis of rating data common in health professions education was illustrated. A causal model was specified and tested. Although most measures clustered around latent traits, there was more method variance in the data set than trait variance. (Author/JAZ)

Correlational analysis, classical test theory, confirmatory factor analysis, and multilevel Rasch modeling were used to refine a measure of adolescents' exposure to violence (ETV). Interpersonal violence could be distinguished from other potentially traumatic events; it was also possible to distinguish three routes of exposure (victimization,…

In this study, the author tested the reliability, concurrent validity, and predictive validity of three hemispheric cognitive style instruments: (a) the Preference Test (PT; R. Zenhausern, 1978), (b) the Polarity Questionnaire (PQ; B. E. Morton, 2002), and (c) the Wagner Preference Inventory II (WAPI II; R. F. Wagner & K. A. Wells, 1985).…