The purpose of this statement is to inform those using or considering the use of value-added models (VAM) about their scientific and technical limitations in the evaluation of educators and programs that prepare teachers. The statement briefly reviews the background and current context of using VAM for evaluations, enumerates specific psychometric…

Psychometrically sound evaluation measures are vital for examining the contribution of professional training to organizational success in a reliable manner. As training evaluations tend to be both time-consuming and labor-intensive, there is an increasing demand for economic evaluation inventories. Simultaneously, evaluation measures have to meet…

The Association to Advance Collegiate Schools of Business (AACSB) International's assurance of learning (AoL) standards require that schools develop a sophisticated continuous-improvement process. The authors review various assessment models and develop a practical, 6-step AoL model based on the literature and the authors' AoL-implementation…

Effective teaching has long been an issue of national concern, but in recent years focus on the effectiveness of programs to produce high-quality teachers has sharpened. Long-standing achievement gaps persist despite large-scale legislative changes at the federal and state levels, and American students continue to show poorer performance on…

High quality measurements are important to evaluate interventions. The study reports on the development of a measurement to investigate authoritative teaching understood as a two-dimensional construct of warmth and control. Through the application of confirmatory factor analysis (CFA) and structural equation modelling (SEM) the factor structure…

Structural equation modeling was used to evaluate the effects of family, child, and both early childhood intervention process and structural variables on parent and family well-being in a sample of 250 parents involved in birth to age three early childhood intervention programs. Family SES and income had direct positive effects, family-centered…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Potential methods are explored for removing or otherwise controlling random measurement error, assessment artifacts, irrelevant variation in outcome measures, and confounding sources of covariation in a structural equations model. Using examples with measures of quality of life and functioning, the authors consider these methods for field…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

Estimates of program effects from a compensatory preschool intervention were investigated using econometric simultaneous modeling, latent variable structured modeling, and ordinary least squares regression. Data for 806 black children indicated that different quasi-experimental estimation methods that attempt to control for selection bias can…

In a previous paper the authors presented a model of assessing portfolios, the Cognitive Model for Assessing Portfolios (CMAP), as a lens to view, think about, and make decisions about portfolio projects. Two projects in which the CMAP has been used are described. One is an authentic assessment project in mathematics and science by the Educational…

This paper focuses on a review of data collected from the second wave of a three wave longitudinal study (Head Start Planned Variations-HSPV) designed to assess the relative impacts of a variety of preschool curricula. Head Start children formerly in the HSPV program were tested when they entered selected Follow Through schools and throughout…

Computer-based testing (CBT) is typically implemented using one of three general test delivery models: (1) multiple fixed testing (MFT); (2) computer-adaptive testing (CAT); or (3) multistage testing (MSTs). This article reviews some of the real cost drivers associated with CBT implementation--focusing on item production costs, the costs…