Factor analysis is a versatile class of psychometric techniques used by researchers to provide insight into the psychological dimensions (factors) that may account for the relationships among variables in a given dataset. The primary goal of a factor analysis is to determine a more parsimonious set of variables (i.e., fewer than the number of…

Item response theory (IRT) models are the main psychometric approach for the development, evaluation, and refinement of multi-item instruments and scaling of latent traits, whereas multilevel models are the primary statistical method when considering the dependence between person responses when primary units (e.g., students) are nested within…

Internal and external coalition functioning is an important predictor of coalition success that has been linked to perceived coalition effectiveness, coalition goal achievement, coalition ability to support evidence-based programs, and coalition sustainability. Understanding which aspects of coalition functioning best predict coalition success…

This study describes the development and validation of the Evaluation Capacity Assessment Instrument (ECAI), a measure designed to assess evaluation capacity among staff of nonprofit organizations that is based on a synthesis model of evaluation capacity. One hundred and sixty-nine staff of nonprofit organizations completed the ECAI. The 68-item…

Minimal evidence exists regarding the retrospective pretest's effectiveness as a tool to obtain usable, indirect evidence of student learning in open admissions institutions. The researcher conducted this study to determine if a retrospective pretest more accurately detected a change in students' knowledge compared to a conventional…

Of particular import to this study, is collider bias originating from stratification on retreatment variables forming an embedded M or bowtie structural design. That is, rather than assume an M structural design which suggests that "X" is a collider but not a confounder, the authors adopt what they consider to be a more reasonable…

Many personnel committees at colleges and universities in the USA use student evaluation of faculty instruction to make decisions regarding tenure, promotion, merit pay or faculty professional development. This study examines the construct validity and internal consistency reliability of the student evaluation of instruction (SEI) used at a large…

When using linear models for cluster-correlated or longitudinal data, a common modeling practice is to begin by fitting a relatively simple model and then to increase the model complexity in steps. New predictors might be added to the model, or a more complex covariance structure might be specified for the observations. When fitting models for…

In an era of evidence-based practice, why are clinicians not typically engaged in evidence-based assessment? To begin to understand this issue, a national multidisciplinary survey was conducted to examine clinician attitudes toward standardized assessment tools. There were 1,442 child clinicians who provided opinions about the psychometric…

This article reports the findings of a survey administering the personal well-being index (PWI) in six Chinese cities (N = 3,390) to ascertain the personal well-being of China's urban population. The specific aims of the study were: (a) ascertain whether Chinese urban residents are satisfied with their lives; (b) validate the PWI using an urban…

We administered two instruments designed to assess and predict teacher effectiveness, the TeacherInsight Interview (TI) and the Renaissance Teacher Work Sample (TWS), to student teachers (N = 396) at a large comprehensive institution in the Southeastern United States to investigate whether TWS performance predicts TI scores. We first investigated…

The factor structure of several self-report questionnaires assessing depression-relevant cognitions frequently employed in clinical research was examined in a sample of 390 adolescents (M age = 14.54; 216 girls; 74% Caucasian) with current major depressive disorder enrolled in the Treatment of Adolescents with Depression Study. A four-factor…

This article examines issues raised by the application of a generic actuarial juvenile risk instrument (the Model Risk Assessment Instrument) to New York City, a context different from the one in which it was developed. It describes practical challenges arising from the constraints of locally available data and local sensibilities and highlights…

Designs and evaluates a multidimensional schema for the assessment of alcohol, tobacco and other drug use topology. Findings illustrate the value of multidimensional assessment for identifying youth at high risk for substance use disorder (SUD) as well as for elucidating the factors contributing to the transition to suprathreshold SUD. (Contains…

A reliability generalization of the Revised Children's Manifest Anxiety Scale (RCMAS) was conducted using the normative sample. The RCMAS consists of a Total Anxiety scale as well as four subscales. Results suggest that the Total Anxiety scores are typically reliable (median across 48 samples = .81). Subscale scores were less reliable: The median…