A method is described for increasing residual degrees of freedom in a community experiment without substantially increasing cost or difficulty by dividing experimental subunits into batches. Theoretical advantages of batch sampling are described and illustrated with data from the Pawtucket Heart Health Program. (SLD)

Compares the efficacy of a combination of phonological and strategy-based remedial approaches for reading disability with that of each approach separately. Study was based on interventions with 85 children with severe reading disability. Results indicate that a combination of Phonological Analysis and Blending/Direct Instruction and Word…

Explores the future of evaluation by drawing on experiences in a professional evaluation network in Namibia and in the context of world events after September 11, 2001. Culture, diversity, and social justice in evaluation must be framed in timeless and global ways. (SLD)

Discusses the history of evaluation research, focusing on current emphasis on "evidence-based policy." Highlights five issues emerging as relevant: evaluation can be done in many ways, serious doubts exist about the usefulness of the term "evaluation," evaluation is held back by paradigm wars, views of evaluation are…

This study investigated the stability of the four factors in the Quality of Life Questionnaire, an instrument often used in quality of life research for people with intellectual disabilities. Only three of the four factors were found to be stable, raising potential concern over the use of the measure in assessing service providers' effectiveness.…

Demonstrates how the latent growth model can be applied to the evaluation of programs targeting HIV risk behavior among drug users. Multigroup piecewise latent growth models were fit to longitudinal data with three repeated response measures. Participants were 430 drug users and their sex partners. (SLD)

Developed an evaluation based on R. Stake's Countenance Model of Program Evaluation (1967) to evaluate the Senior Block Field Experience Program at Mississippi State University, a teacher education program. Results identify strengths and weaknesses in all components of the program. (SLD)

Measures outcomes of a group treatment for five- to eight-year-old sexually abused children. Results find that children improved significantly from pre-treatment to mid-treatment on measures of problematic behavior, sexual information and abuse prevention. Suggests that young children do benefit from a sexual abuse group treatment and that a…

Presents results of research focusing on identifying "certification best practices" to provide a framework for business managers and certification practitioners. Describes a 10-step process for evaluating certification programs that takes into consideration four perspectives: audience, learning, business, and financial. (AEF)

The following dimensions for effective reaction evaluations as a tool in training program evaluations are described: program objective(s)/content; program materials; delivery methods/technologies; instructor/facilitator; instructional activities; program time/length; training environment; planned action/transfer expectation;…

Five models of program evaluation--needs assessment, feasibility study, process evaluation, outcome evaluation, and cost analysis--are described, and how they differ from research is explained. Six groups of stakeholders are identified, reasons for doing evaluations are discussed, qualitative and quantitative methods are described, five stages of…

Takes a discourse-analytic approach to study the research that two managers carried out in an educational institution to produce and legitimate knowledge used for decision making. Shows that the writing and reading of notes taken during interviews conducted as part of the research was a crucial step in the construction of the knowledge in which…

Social skill deficits have become a defining characteristic of students with specific learning disability (SLD). Attempts have been made to enhance social functioning through structured training approaches. The effectiveness of these efforts was evaluated in a quantitative research synthesis (meta-analysis), which revealed a "small" effect with…

A conceptual model for evaluating community-based program sustainability is presented, along with a 53-item Program Sustainability Index (PSI). Structural equation modeling (SEM) and principal axis factor analysis indicate strong support for each of the seven elements of the PSI. When considered as an overall model, six of the seven framework…

The paper discusses two common scenarios in which evaluators must conduct impact evaluations when working under budget, time, or data constraints. Under the first scenario the evaluator is not called in until the project is already well advanced, and there is a tight deadline for completing the evaluation, frequently combined with a limited budget…