Psychometrically sound evaluation measures are vital for examining the contribution of professional training to organizational success in a reliable manner. As training evaluations tend to be both time-consuming and labor-intensive, there is an increasing demand for economic evaluation inventories. Simultaneously, evaluation measures have to meet…

The Association to Advance Collegiate Schools of Business (AACSB) International's assurance of learning (AoL) standards require that schools develop a sophisticated continuous-improvement process. The authors review various assessment models and develop a practical, 6-step AoL model based on the literature and the authors' AoL-implementation…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

Estimates of program effects from a compensatory preschool intervention were investigated using econometric simultaneous modeling, latent variable structured modeling, and ordinary least squares regression. Data for 806 black children indicated that different quasi-experimental estimation methods that attempt to control for selection bias can…

In a previous paper the authors presented a model of assessing portfolios, the Cognitive Model for Assessing Portfolios (CMAP), as a lens to view, think about, and make decisions about portfolio projects. Two projects in which the CMAP has been used are described. One is an authentic assessment project in mathematics and science by the Educational…

Potential methods are explored for removing or otherwise controlling random measurement error, assessment artifacts, irrelevant variation in outcome measures, and confounding sources of covariation in a structural equations model. Using examples with measures of quality of life and functioning, the authors consider these methods for field…

Computer-based testing (CBT) is typically implemented using one of three general test delivery models: (1) multiple fixed testing (MFT); (2) computer-adaptive testing (CAT); or (3) multistage testing (MSTs). This article reviews some of the real cost drivers associated with CBT implementation--focusing on item production costs, the costs…

The preliminary results of four of six research methodologies used to evaluate a professional development curriculum in an urban school are described and reported. The paper begins with a discussion of the social systems model underlying the project, a brief summary of the transactional evaluation scheme used to direct research efforts, a…