The What Works Clearinghouse (WWC) evaluates research studies that look at the effectiveness of education programs, products, practices, and policies, which the WWC calls "interventions." Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal…

Although collaboration is recognized as an effective means to address multifaceted community issues, successful collaboration is difficult to achieve and failure is prevalent. To effectively collaborate, collaborators must recognize the strengths and weaknesses within their own efforts. Using Mattessich and colleagues' work as a springboard, a…

Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…

This research evaluated the inter-rater reliability of the Performance Assessment for California Teachers (PACT). Multiple methods for estimating overall rater consistency include percent agreement and Cohen's Kappa (1960), which yielded discrepancies between rater agreement in terms of whether candidates passed or failed particular PACT rubrics.…

The Program Quality Criteria include ten components designed to help validate a comprehensive career and technical education (CTE) program. Upon a self review or third party review, any program may use this instrument to determine how the program has made progress in its development. The review instrument is not designed as an evaluation tool,…

The purpose of this study was to develop a tool to evaluate the quality of a clinical information system (CIS) conceived by nurses and conduct a pilot test with the developed tool as an initial assessment. CIS quality is required for successful implementation in information technology (IT) environments. The study started with the realization that…

The current study examined the validation and alignment of the PASA-Science by determining whether the alternate science assessment anchors linked to the regular education science anchors; whether the PASA-Science assessment items are science; whether the PASA-Science assessment items linked to the alternate science eligible content, and what…

School-wide positive behavior support (SWPBS) has been implemented in more than 4,000 schools as a means of addressing problem behavior in a systemic fashion. Preliminary outcomes (e.g., office discipline referrals, suspensions) indicate the effectiveness of SWPBS in decreasing school-wide behavior problems and creating a positive school climate.…

The state validation process in New York identifies promising practices developed through the Elementary Secondary Education Act Title IV-C funding. The new validation procedures included in this handbook are revised to: (1) make the evaluation process easier to apply; (2) provide technical assistance in evaluating the project; (3) extend…

This guide provides a brief overview of the issues involved in the validation process. It was developed for evaluators of adult education projects, such as 310 projects. The guide is organized in three sections. The first section discusses the rationale for validation. The second section describes the characteristics of validation models. The…

This study examined a model of assessment that could be applied nationally for Year Twelve Vocational Education and Training (VET) subjects and which could yield both a differentiating score and recognition of competence. More than fifty colleges across all states and territories of Australia field-tested the approach over one school year. Results…

In this article, a new method is presented and implemented for deriving a scale of socioeconomic status (SES) from international survey data using a multilevel Bayesian item response theory (IRT) model. The proposed model incorporates both international anchor items and nation-specific items and is able to (a) produce student family SES scores…

The Joint Dissemination Review Panel (JDRP) examines educational interventions and determines their effectiveness. This study's purpose was to assess this review process and identify common characteristics of submittals and ways in which approvals and rejections differed. A locally-developed instrument which collected data on the intervention's…

This review of a previous article (TM 503 836), concludes that: (1) the evaluation methodology was straightforward; (2) simpler data analysis would have yielded the same conclusions; and (3) exclusion of many experimental schools from data analysis and use of post hoc matching and covariance produced misleading results. (CP)

This letter reports on a research study in which five students (initially identified as severely mentally retarded and/or autistic) were tested with and without the use of facilitated communication while facilitators were prevented from hearing the test questions. Positive results for four of the students raise issues about accurate educational…