Planning and implementing online professional development opportunities is challenging but attainable. This paper explains how a group of librarians from different institutions worked to plan, market, implement, and evaluate monthly webinars as well as an inaugural online conference, despite never meeting in person. The web conferences began…

Based on perceived student resistance to peer review, we conducted a study to lessen this resistance and demystify the writing process for STEM students. While many composition theorists advocate for peer review in the classroom, its application at a STEM institution remains underexamined. To foster student engagement with peer review, we…

This article presents an in-depth model to train school counseling students in program evaluation. Steps outlined in the model include partnering with a local nonprofit organization, conducting a literature review, developing a research question and hypothesis, detailing the evaluation instrument selection process, and outlining the program…

Using a multisite cluster-randomized controlled trial design, we evaluated the effect of the first year of a three-year teacher professional development called Cognitively Guided Instruction (CGI) on third -fifth grade students' mathematics achievement. Teachers in the intervention condition participated in nine days of professional development…

The purpose of this study was to conduct an evaluation on a workplace training program using the Community of Inquiry (COI) model as a guide for course construction. Given that online and blended learning programs have gained popularity in the past two decades, companies have struggled with how to prepare trainers in the areas of online teaching…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

Remediation has long been a costly way to address the misalignment between K-12 and higher education. In 2011, the California State University (CSU), the nation's largest public four-year university system, enacted "Early Start," requiring students needing remediation to enroll in such courses in the summer before their freshman year. We…

The New World Kirkpatrick (NWKM) four-level model is a new vision of the Kirkpatrick Model. NWKM adds new elements to recognize the complication of the educational program background and to evaluate the effectiveness of continuing education. This study used data collected from subjects, distributed to 393 participants enrolled in an acupuncture…

This document offers a summary of key findings and learnings from a preliminary evaluation of the Quality Support Program (QSP) by Australian Children's Education and Care Quality Authority (ACECQA). The QSP is an initiative of the NSW Department of Education Early Childhood Education Directorate (NSW DoE) involving the delivery by ACECQA of free…

Evidence-based policy at the local level requires predicting the impact of an intervention to inform whether it should be adopted. Increasingly, local policymakers have access to published research evaluating the effectiveness of policy interventions from national research clearinghouses that review and disseminate evidence from program…

This article examines the concept of credible evidence in Extension evaluations with specific attention to the measures and measurement strategies used to collect and create data. Credibility depends on multiple factors, including data quality and methodological rigor, characteristics of the stakeholder audience, stakeholder beliefs about the…

One approach to designing, researching or evaluating professional learning experiences is to use models of learning processes. Here we analyse and critique five significant contemporary analytical models: three variations on path models, proposed by Guskey, by Desimone and by Clarke and Hollingsworth; a model using a systemic conceptualisation of…

Through a sensitivity analysis, the analyst attempts to determine whether a conclusion of causal inference could be easily reversed by a plausible violation of an identification assumption. Analytic conclusions that are harder to alter by such a violation are expected to add a higher value to scientific knowledge about causality. This article…

Programs for domestic violence (DV) victims and their families have grown exponentially over the last four decades. The evidence demonstrating the extent of their effectiveness, however, often has been criticized as stemming from studies lacking scientific rigor. A core reason for this critique is the widespread belief that credible evidence can…

Evaluators frequently confront situations in which local programs struggle to meet the expectations and requirements specified by the external program funder. How can evaluators meaningfully evaluate programs (for both the funder and grantee) in situations in which the external program logic clashes with local complexities? This paper discusses…