Factor analysis is widely utilized to identify latent factors underlying the observed variables. This paper presents a comprehensive comparative study of two widely used methods for determining the optimal number of factors in factor analysis, the K1 rule, and parallel analysis, along with a more recently developed method, the bass-ackward method.…

There has been increased interest in assessing the quality and usefulness of short versions of the Raven's Progressive Matrices. A recent proposal, composed of the last twelve matrices of the Standard Progressive Matrices (SPM-LS), has been depicted as a valid measure of "g." Nonetheless, the results provided in the initial validation…

Supervisors evaluated counselors-in-training at multiple points during their practicum experience using the Counseling Competencies Scale (CCS; N = 1,070). The CCS evaluations were randomly split to conduct exploratory factor analysis and confirmatory factor analysis, resulting in a 2-factor model (61.5% of the variance explained).

Popular teamwork assessments have been strongly criticized on the grounds of poor psychometric properties and their disconnect with conceptual models of teamwork. These issues raise concerns with respect to our ability to evaluate efforts devoted to advancing teamwork in academia. We report the development of a teamwork assessment that builds on…

Challenge course programs influence a variety of psychological, social, and educational outcomes. Yet, many challenges exist when measuring challenge course outcomes like logistical constraints and a lack of specific assessment tools. This study piloted and tested an assessment tool designed for facilitators to measure participant outcomes in…

This study aimed to develop a valid and reliable measurement tool to enhance ethical evaluation literature. The tool consists of two subscales named "Bases of ethical evaluation," and "Grounds of ethical evaluation." In order to determine the factor structure of the scales, both exploratory and confirmatory factor analyses were…

This study presents the development process and initial validation of the NyTid test, a process-oriented movement assessment tool for compulsory school pupils. A sample of 1,260 (627 girls and 633 boys; mean age of 14.39) Swedish school children participated in the study. In the first step, exploratory factor analyses (EFAs) were performed in…

Psychometrically sound evaluation measures are vital for examining the contribution of professional training to organizational success in a reliable manner. As training evaluations tend to be both time-consuming and labor-intensive, there is an increasing demand for economic evaluation inventories. Simultaneously, evaluation measures have to meet…

There is a lack of research on the effects of outliers on the decisions about the number of factors to retain in an exploratory factor analysis, especially for outliers arising from unintended and unknowingly included subpopulations. The purpose of the present research was to investigate how outliers from an unintended and unknowingly included…

Statistical analyses investigating latent structure can be divided into those that estimate structural model parameters and those that detect the structural model type. The most basic distinction among structure types is between categorical (discrete) and dimensional (continuous) models. It is a common, and potentially misleading, practice to…

Recently graduated university students from all Australian Universities rate their overall departmental and university experiences (DUEs), and their responses (N = 44,932, 41 institutions) are used by the government to benchmark departments and universities. We evaluate this DUE strategy of rating overall departments and universities rather than…

When comparing latent variables among groups, it is important to first establish the equivalence or invariance of the measurement model across groups. Confirmatory factor analysis (CFA) is a commonly used methodological approach to examine measurement equivalence/invariance (ME/I). Within the CFA framework, the chi-square goodness-of-fit test and…

This study was designed to assess the (score) construct-related validity of an instrument called the School-Wide Cultural Competence Observation Checklist (SCCOC). The instrument was developed to use as a tool in conducting culture audits as a means of assessing school-wide cultural competence, or how well a school's programs, policies, and…

The overarching intent of this article is to exemplify strategies associated with tests for measurement invariance that are uncommonly applied and reported in the extant literature. Designed within a pedagogical framework, the primary purposes are 3-fold and illustrate (a) tests for measurement invariance based on the analysis of means and…

This article is concerned with the seemingly simple problem of testing whether latent factors are perfectly correlated (i.e., statistically indistinct). In recent literature, researchers have used different approaches, which are not always correct or complete. We discuss the parameter constraints required to obtain such perfectly correlated latent…