Wording effects associated with positively and negatively worded items have been found in many scales. Such effects may threaten construct validity and introduce systematic bias in the interpretation of results. A variety of models have been applied to address wording effects, such as the correlated uniqueness model and the correlated traits and…

This article presents a comparative judgment approach for holistically scored constructed response tasks. In this approach, the grader rank orders (rather than rate) the quality of a small set of responses. A prior automated evaluation of responses guides both set formation and scaling of rankings. Sets are formed to have similar prior scores and…

The study aimed to develop the Homophobic Bullying Scale and to investigate its psychometric properties. The items of the Homophobic Bullying Scale were created to measure high school students' bullying behaviors motivated by homophobia, including verbal bullying, relational bullying, physical bullying, property bullying, sexual harassment, and…

Statistical biases associated with single-level analyses underscore the importance of partitioning variance/covariance matrices into individual and group levels. From a multilevel perspective based on data from 21,579 students in 58 high schools, the present study assesses the multilevel factor structure of motivation and engagement with a…

The authors examined the dimensionality of the VARK learning styles inventory. The VARK measures four perceptual preferences: visual (V), aural (A), read/write (R), and kinesthetic (K). VARK questions can be viewed as testlets because respondents can select multiple items within a question. The correlations between items within testlets are a type…

In 2001, Elliot and McGregor proposed a 2 x 2 (mastery-performance x approach- avoidance) achievement goal frameworks and developed a questionnaire to measure four goals (mastery-approach, mastery-avoidance, performance-approach, and performance-avoidance goals). This study examines the dual meanings of items in 2 x 2 achievement goal…

This study compares two confirmatory factor analysis methods on their ability to verify whether correct assignments of items to subtests are supported by the data. The confirmatory common factor (CCF) method is used most often and defines nonzero loadings so that they correspond to the assignment of items to subtests. Another method is the oblique…

The current research extended the three-factor (mastery, performance-approach, and performance-avoidance) measure of achievement goals in a work domain to the four-factor conceptualization (in a 2 x 2 framework) by adding items to represent mastery-avoidance goals. Confirmatory factor analysis was conducted on two independent samples to evaluate…

The current study compared student performance between paper-and-pencil testing (PPT) and computer-based testing (CBT) on a large-scale statewide end-of-course English examination. Analyses were conducted at both the item and test levels. The overall results suggest that scores obtained from PPT and CBT were comparable. However, at the content…

This study examined the factor structure of a Korean version of the Perceptual Learning Styles Preference Questionnaire. The instrument was developed to measure the learning-style preferences of students of English as a second language and English as a foreign language and has gained wide currency as a classroom diagnostic tool and survey…

The construct validity of scores on the Student Adaptation to College Questionnaire (SACQ) was examined using confirmatory factor analysis (CFA). The purpose of this study was to test the fit of the SACQ authors' proposed four-factor model using a sample of university students. Results indicated that the hypothesized model did not fit. Additional…

Expectations for reporting factor analysis results as part of construct validation are explored in the context of emerging views of measurement validity. Desired practices are discussed for both exploratory and confirmatory factor analysis. A short computer program for conducting parallel analysis is included. (Author/SLD)

Performed exploratory factor analysis of the responses of 458 older adults, aged 60 to 100 years, to the Adult Manifest Anxiety Scale-Elderly Version (based on a scale by J. Taylor, 1953). Found a three-factor structure of anxiety consistent with current theories of anxiety that supports the construct validity of the measure. (SLD)

Ensuring construct comparability is a prerequisite for testing cross-group differences, yet this assumption is rarely tested in mentoring research. More studies testing for factorial invariance are needed for the construct validation of mentoring. Multiple group confirmatory factor analyses (CFAs) were used to investigate the factorial stability…

Managers are increasingly being held accountable for providing resources that support employee development, particularly in the form of feedback and coaching. To support managers as trainers and coaches, organizations must provide managers with the tools they need to succeed in this area. This article presents a new tool to assist in the diagnosis…