We review common situations in Bayesian latent variable models where the prior distribution that a researcher specifies differs from the prior distribution used during estimation. These situations can arise from the positive definite requirement on correlation matrices, from sign indeterminacy of factor loadings, and from order constraints on…

Structural equation models comprise a large class of popular statistical models, including factor analysis models, certain mixed models, and extensions thereof. Model estimation is complicated by the fact that we typically have multiple interdependent response variables and multiple latent variables (which may also be called random effects or…

The study aims to examine the interplay of two critical constructs in evaluation: essential evaluator competency and evaluator practice. The research questions in this study, according to Smith (2008), are essentially, what he defined as "fundamental issues in evaluation." These issues fall into one or multiple of the four aspects…

The issue of measurement invariance commonly arises in factor-analytic contexts, with methods for assessment including likelihood ratio tests, Lagrange multiplier tests, and Wald tests. These tests all require advance definition of the number of groups, group membership, and offending model parameters. In this paper, we study tests of measurement…

We examined whether fluid intelligence (Gf) is better predicted by the storage capacity of active memory or by the effectiveness of executive control. In two psychometric studies, we measured storage capacity with three kinds of task which required the maintenance of a visual array, the monitoring of simple relations among perceptually available…

The Technological Pedagogical Content Knowledge (TPCK) framework has been adopted by many educational technologists and teacher educators for the research and development of knowledge about the pedagogical uses of Information and Communication Technologies (ICT) in classrooms. While the framework is potentially very important, efforts to survey…

This study describes the development and validation of the Evaluation Capacity Assessment Instrument (ECAI), a measure designed to assess evaluation capacity among staff of nonprofit organizations that is based on a synthesis model of evaluation capacity. One hundred and sixty-nine staff of nonprofit organizations completed the ECAI. The 68-item…

In international achievement studies, questionnaires typically ask about the presence of particular household assets in students' homes. Responses to the assets questions are used to compute a total score, which is intended to represent household wealth in models of test performance. This study uses item analysis and confirmatory factor analysis…

High quality measurements are important to evaluate interventions. The study reports on the development of a measurement to investigate authoritative teaching understood as a two-dimensional construct of warmth and control. Through the application of confirmatory factor analysis (CFA) and structural equation modelling (SEM) the factor structure…

As Rupp and Templin (2008) stated directly, diagnostic classification methods "are confirmatory in nature." Methods, though, are neither inherently confirmatory nor exploratory. Diagnostic classification modeling, with its analytical and computational obstacles eventually yielding as a comprehensive and potent discipline emerges, will…

Higher-order approximations to the distributions of fit indexes for structural equation models under fixed alternative hypotheses are obtained in nonnormal samples as well as normal ones. The fit indexes include the normal-theory likelihood ratio chi-square statistic for a posited model, the corresponding statistic for the baseline model of…

The Diagnostic Teacher Assessment in Mathematics and Science (DTAMS) was developed to measure the content knowledge and pedagogical content knowledge of middle-school teachers. Its reliability and validity were initially established by reviewing national standards for content and use of expert question writing teams and reviewers. DTAMS was…

Statistical methodology for handling omitted variables is presented in a multilevel modeling framework. In many nonexperimental studies, the analyst may not have access to all requisite variables, and this omission may lead to biased estimates of model parameters. By exploiting the hierarchical nature of multilevel data, a battery of statistical…

This collection of diverse conference papers discusses work in the traditions of factor analysis, ordinal psychometrics, structural equations, and some special purpose models for the analysis of change. It is a useful source, but does little to link the psychometric framework to general developments in statistics and other disciplines. (SLD)

The Youth Self Report (YSR) is a popular and widely used instrument assessing adolescent emotional and behavioral functioning. The goals of the present study were to address some of the limitations of the YSR, to examine its factor structure and equivalence across four racial/ethnic groups, and to determine if another combination of items could…