The population relationship between coefficient alpha and scale reliability is studied in the widely used setting of unidimensional multicomponent measuring instruments. It is demonstrated that for any set of component loadings on the common factor, regardless of the extent of their inequality, the discrepancy between alpha and reliability can be…

Multidimensionality and hierarchical data structure are common in assessment data. These design features, if not accounted for, can threaten the validity of the results and inferences generated from factor analysis, a method frequently employed to assess test dimensionality. In this article, we describe and demonstrate the application of the…

Practitioners of adult education have a long history of teaching for social change. They may, however, be uncomfortable using quantitative methods to assess the impact of their learning activities, or they might lack access to statistical analysis software. Quantitative methods help the practitioner determine whether behavioral or attitudinal…

Latent growth modeling (LGM) is a popular and flexible technique that may be used when data are collected across several different measurement occasions. Modeling the appropriate growth trajectory has important implications with respect to the accurate interpretation of parameter estimates of interest in a latent growth model that may impact…

Utilizing the perspective of finite mixture modeling, this note considers whether a finding of a plausible one-parameter logistic model could be spurious for a population with substantial unobserved heterogeneity. A theoretically and empirically important setting is discussed involving the mixture of two latent classes, with the less restrictive…

Structured means analysis is a very useful approach for testing hypotheses about population means on latent constructs. In such models, a z test is most commonly used for testing the statistical significance of the relevant parameter estimates or of the differences between parameter estimates, where a z value is computed based on the asymptotic…

Abundant research in social psychology shows human behaviour is guided by beliefs through two pathways, a deliberate and automatic pathway. Research on student motivation has thus far focused mostly on the deliberate pathway and consequently almost exclusively relied on explicit measures (i.e. self-reports of motivation) to assess student…

Based upon self-concept and self-determination theory, the present study aimed to examine the measurement separability of young children's math self-concept (MSC) and six specific types of motivation, namely, intrinsic motivation (INTR), integrated motivation (INTEG), identified motivation (IDENT), introjected motivation, extrinsic motivation…

An important aspect of qualitative research is reaching saturation--loosely, a point at which observing more data will not lead to discovery of more information related to the research questions. However, there has been no validated means of objectively establishing saturation. This article proposes a novel quantitative approach to measuring…

Background: Although callous-unemotional (CU) traits have been associated with bullying among children and adolescents, relatively little is known about whether each of the three sub-constructs of CU traits--callous, uncaring, and unemotional--are associated with bullying when they are considered concurrently in the analysis. Objective: This study…

This paper investigates reasoned risk-taking in decision-making by school principals using a methodology that combines sequential use of psychometric and traditional measurement techniques. Risk-taking is defined as when decisions are made that are not compliant with the regulatory framework, the primary governance mechanism for public schools in…

This study examined an extended theory of planned behaviour (TPB) model that specified factors affecting students' intentions to collaborate online for group work. Past behaviour, past experience and actual behavioural control were incorporated in the extended TPB model. The mediating roles of attitudes, subjective norms and perceived behavioural…

This study compared accuracy of energy expenditure (EE) prediction models from accelerometer data collected in structured and simulated free-living settings. Twenty-four adults (mean age 45.8 years, 50% female) performed two sessions of 11 to 21 activities, wearing four ActiGraph GT9X Link activity monitors (right hip, ankle, both wrists) and a…

When researchers fit statistical models to multiply imputed datasets, they have to fit the model separately for each imputed dataset. Since there are multiple datasets, there are always multiple sets of model results. It is possible for some of these sets of results not to converge while some do converge. This study examined occurrence of such a…

The literature on Automated Essay Scoring (AES) systems has provided useful validation frameworks for any assessment that includes AES scoring. Furthermore, evidence for the scoring fidelity of AES systems is accumulating. Yet questions remain when appraising the scoring performance of AES systems. These questions include: (a) which essays are…