The purpose of the present study was to provide the means to evaluate the "interval-scaling" assumption that governs the use of parametric statistics and continuous data estimators in self-report instruments that utilize Likert-type scaling. Using simulated and real data, the methodology to test for this important assumption is evaluated…

To improve the validity of self-report measures, researchers should control for response style (RS) effects, which can be achieved with IRTree models. A traditional IRTree model considers a response as a combination of distinct decision-making processes, where the substantive trait affects the decision on response direction, while decisions about…

Automated scoring of free drawings or images as responses has yet to be used in large-scale assessments of student achievement. In this study, we propose artificial neural networks to classify these types of graphical responses from a TIMSS 2019 item. We are comparing classification accuracy of convolutional and feed-forward approaches. Our…

This article introduces a new construct coined as Computer User Learning Aptitude (CULA). To establish construct validity, CULA is embedded in a nomological network that extends the technology acceptance model (TAM). Specifically, CULA is posited to affect perceived usefulness and perceived ease of use, the two underlying TAM constructs.…

Applications of distribution theory for the squared multiple correlation coefficient and the squared cross-validation coefficient are reviewed, and computer programs for these applications are made available. The applications include confidence intervals, hypothesis testing, and sample size selection. (Contains 2 tables.)

When selection occurs on the basis of two or more predictors, multivariate restriction of range can reduce various parameters of a validation study. A Statistical Analysis System (SAS) and a Fortran IV program are described that allow for correction of criterion standard deviation(s) and zero-order validities. (Author)

Expectations for reporting factor analysis results as part of construct validation are explored in the context of emerging views of measurement validity. Desired practices are discussed for both exploratory and confirmatory factor analysis. A short computer program for conducting parallel analysis is included. (Author/SLD)

Effects of choice of data analysis program on outcomes of meta-analysis were studied by considering the extent to which four commonly used Schmidt and Hunter validity generalization-based meta-analytic software programs produce identical outcomes. Differences were minor and did not influence outcomes. (SLD)

Three numerical coefficients for analyzing the validity and reliability of ratings are described. Each coefficient is computed as the ratio of an obtained to a maximum sum of differences in ratings. The coefficients are also applicable to the item analysis, agreement analysis, and cluster or factor analysis of rating-scale data. (Author/BW)