The possible dependency of criterion validity on item formulation in a multicomponent measuring instrument is examined. The discussion is concerned with evaluation of the differences in criterion validity between two or more groups (populations/subpopulations) that have been administered instruments with items having differently formulated item…

When cognitive and educational tests are administered under time limits, tests may become speeded and this may affect the reliability and validity of the resulting test scores. Prior research has shown that time limits may create or enlarge gender gaps in cognitive and academic testing. On average, women complete fewer items than men when a test…

Automated scoring of free drawings or images as responses has yet to be used in large-scale assessments of student achievement. In this study, we propose artificial neural networks to classify these types of graphical responses from a TIMSS 2019 item. We are comparing classification accuracy of convolutional and feed-forward approaches. Our…

The maximal reliability of a congeneric measure is achieved by weighting item scores to form the optimal linear combination as the total score; it is never lower than the composite reliability of the measure when measurement errors are uncorrelated. The statistical method that renders maximal reliability would also lead to maximal criterion…

The purpose of the present studies was to test the hypothesis that the psychometric characteristics of ability scales may be significantly distorted if one accounts for emotional factors during test taking. Specifically, the present studies evaluate the effects of anxiety and motivation on the item difficulties of the Rasch model. In Study 1, the…

This article investigates the effect of the rural-urban divide on mean response styles (RSs) and their relationships with the sociodemographic characteristics of the respondents. It uses the Representative Indicator Response Style Means and Covariance Structure (RIRSMACS) method and data from Guyana--a developing country in the Caribbean. The…

Many psychological scales written in the Likert format include reverse worded (RW) items in order to control acquiescence bias. However, studies have shown that RW items often contaminate the factor structure of the scale by creating one or more method factors. The present study examines an alternative scale format, called the Expanded format,…

This article describes the development, validation, and measurement invariance of scores from a survey designed to measure preservice teachers' reported acceptance of technology. Drawing from conceptual models in the areas of information systems and technology acceptance, a five-factor Technology Acceptance Measure for Preservice Teachers (TAMPST)…

The primary aim of this study was to examine the psychometric properties of the scores on a version for children of the Carver and White Behavioral Inhibition and Activation scales (the BIS-BAS scales). This involved administering the BIS-BAS scales, the Positive and Negative Affect Schedule, the Junior Eysenck Personality Questionnaire…

This study examined the cultural relevance of adult attachment within a Korean sample (N = 390) using Rasch rating scale modeling. The psychometric properties of scores from the Korean version of the Revised Experiences in Close Relationships, comprised of two subscales of Anxiety (self) and Avoidance (other), were assessed. Results obtained from…

This study provides a summary of 45 exploratory and confirmatory factor-analytic studies that examined the internal structure of scores obtained from the Maslach Burnout Inventory (MBI). It highlights characteristics of the studies that account for differences in reporting of the MBI factor structure. This approach includes an examination of the…

The structure of the six vocational interests measured by the Holland Vocational Preference Inventory was identified. Results of two separate analyses showed that a general factor accounted for much of the total variance. Remaining bipolar factors supported previous classifications of interests. (Author/GK)

The purpose of this study was to determine the concurrent validity of the Learning Ability Profile (LAP) by correlating the results obtained on the LAP with grade point average (GPA). Scores on LAP, both weighted and nonweighted, were correlated .30 and .31, respectively, with GPA. (Author/BW)

Three multiple-abilities batteries--the Comprehensive Ability Battery, Differential Aptitude Tests, and General Aptitude Test Battery--are briefly discussed, and results of a study involving cross-correlations of the tests in these batteries are presented. (Author/JKS)

The validity of spelling tests in several formats was investigated against the criterion of an estimate of spelling accuracy in ranked writing samples. The correlation between writing samples and spelling production was greater than with recognition of correct spelling. Variations in reliability and rankings were not responsible for the…