The purpose of this study was to further investigate the relationship between the instruments identified by Kose and developed by Maras et al. (2013), Astramovich (2016), and Dimmitt et al. (2007) to provide validation to the proposed taxonomy of program evaluation competencies for school counselors. Theoretically, these instruments should be…

This article illustrates an argument-based approach to presenting validity evidence for assessment items intended to measure a complex construct. Our focus is developing a measure of teachers' ability to analyze and respond to students' mathematical thinking for the purpose of program evaluation. Our validity argument consists of claims addressing…

Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

Objective: Application of the Transtheoretical Model (TTM) to Supplemental Nutrition Assistance Program Education (SNAP-Ed) evaluation and development and validation of an evaluation tool used to measure TTM constructs is described. Methods: Surveys were collected from parents of children receiving food at Summer Food Service Program sites prior…

With the proliferation of the Internet and World Wide Web applications, people are increasingly interacting with government to citizen (G2C) eGovernment systems. It is therefore important to measure the success of G2C eGovernment systems from the citizen's perspective. While general information systems (IS) success models have received much…

The aim of this study was to examine the underlying structure of the Evaluation Scale of Educational Programme Implementation (ESEPI). The ESEPI consists of six factors that play an important role in educational programme implementation, namely: training, educational material, administration, facilities, relationships and educational procedure.…

Developed a 15-item fidelity scale to assess the extent to which vocational programs for people with severe mental illness followed the Individual Placement and Support model of supported employment. Results indicate that interrater reliability and internal consistency were adequate. Should help differentiate programs following a specific model…

This study examined the appropriateness of the use of criterion referenced tests as a means of controlling an individual student's advancement to the next level of instruction or retention in the current unit in the PLATO Air Force Base Computer-Based Education project at Chanute. The study was also concerned with program evaluation, which…

The differentiated outcome hypothesis posits that the maximum effects of an educational program are realized along those dimensions emphasized in the program or in those central to the persons involved. The idea that educational programs employing unconventional means should be examined on outcomes that are consistent with those means is derived…

Two ESEA Title I evaluation models developed by the Resource Management Corporation (RMC), were field tested simultaneously with 560 Title I reading students, grades 2-8. Measuring instruments for models 1 and 2 were, respectively, the California Achievement Test (reading vocabulary section), a norm-referenced test; and the Tarmac Reading…

Technical considerations associated with item selection and reliability assessment are considered in relation to criterion-referenced tests constructed to provide group information. The purpose is to emphasize test building and the evaluation of test scores in program evaluation studies. It is stressed that an evaluator employ a performance or…

The purpose of this study was to determine the value of the Grotelueschen evaluation model in terms of six criteria: usability, comprehensiveness, cost-effectiveness, flexibility, validity, and objectivity. This evaluation process was chosen from six models that were reviewed to determine the effectiveness of an adult education program on career…

A liberal interpretation of Section 151 of Public Law 93-380, to implement effective local evaluation of Title I programs, is supported. Weaknesses are cited: (1) nationwide impact data, (2) unsound aggregation of Title I achievement gains, and (3) lack of consideration of alternative evaluation methods. (MH)

The validity of the Comprehensive Tests of Basic Skills (CTBS) and problems associated with inappropriate norms were investigated in eleven senior high schools in Phoenix, Arizona. CTBS validity was assessed in three ways: (1) correlation between test scores and number of courses taken in that subject; (2) correlation between CTBS scores and…

Threats to the validity of the Title I Evaluation and Reporting System are covered in two parts: an annotated bibliography of reports concerned with technical issues, and a discussion of threats to validity--from the reporting system in general and from each model in particular. Threats common to all three evaluation models are reported:…