This study investigated the efficacy of the Beyond Rubrics Toolkit (BRT) as an embedded assessment instrument within makerspaces. Conducted as a pilot study at two Boys & Girls Club sites during afterschool programming, the research aimed to address the following research questions: (1) What skills are Youth Development Professionals teaching…

In 2016, with mounting pressure from parents, educators, and other stakeholders around the state pushing back against the volume of standardized tests students are required to take, the Texas Education Agency introduced the Texas Writing Pilot. This pilot was designed to study the feasibility of creating an alternative writing assessment that…

World Education Services (WES) is a non-profit organization with over 40 years of experience in assessing academic credentials from more than 200 countries and jurisdictions and 40,000 educational institutions. Because many refugees are unable to obtain verifiable documents, the assessment of their qualifications calls for a different approach…

Program participants have been largely excluded as an evidence source in realist evaluations. We test whether and how lived experience as described through life history interviews with pilot program participants can be used as a valid and unique source of data for elucidating context (C)--mechanism (M)--outcome (O) configurations and informing…

World Education Services (WES) is a non-profit organization with over 40 years of experience in assessing academic credentials from more than 200 countries and jurisdictions and 40,000 educational institutions. Because many refugees are unable to obtain verifiable documents, the assessment of their qualifications calls for a different approach…

This article introduces a set of evidence-based principles to guide evaluation practice in contexts where evaluation knowledge is collaboratively produced by evaluators and stakeholders. The data from this study evolved in four phases: two pilot phases exploring the desirability of developing a set of principles; an online questionnaire survey…

Denver Public Schools' Professional Learning Center was still relatively new when it decided to tackle a problem of practice that has vexed systems and departments across the country: How to measure the impact of professional learning. To do so, the Professional Learning Center created a new comprehensive measurement approach--one that would…

Monitoring fidelity of implementation is a critical task when initiating evidence-based programs. This pilot study sought to identify best practices in a fidelity monitoring process and determine the feasibility of continuing a fidelity monitoring process with a multisite, multiprogram initiative. A fidelity log was created for each of 11…

A full-scale oral communication assessment was conducted by the Virginia Community College System (VCCS) during the academic year 2013-14. Key components of this assessment included faculty involvement at all stages of assessment and collaboration with assessment coordinators and lead staff personnel. The VCCS Office of Institutional Research and…

Extensive graded reading (EGR) was carried out with a cohort of 600 engineering students in a university in northern Japan. Pre-and post-surveys were conducted to discover changes in the general reading habits of students, their attitudes toward the assessment method and how goals changed over the course of study. The first survey was carried out…

Classroom physical activity (PA) has been linked to a multitude of health and academic benefits. However, due to barriers such as lack of time and resources many teachers are not implementing classroom PA to the degree they would like to. One innovative solution is to integrate classroom PA into academic concepts. Based on self-determination…

This pilot project focused on improving teachers' understanding and use of effective feedback. Participating teachers tried to incorporate feedback into their lessons to help pupils understand their learning goals and become able to develop strategies to reach them. The project employed a cyclical action research design, through which teachers…

In times of diminishing resources to support community programs, it is critical that Extension make every effort to show impact as collectively as possible for the variety of programs being delivered in individual counties and communities. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810), focused on outcomes in…

Innovations and new project ideas often emerge in networks of researchers, users of research, and societal actors. This article analyzes and discusses how research scientists learn to conduct research that has an impact on their clients, scientific community, and society. We describe a new developmental impact evaluation method based on the theory…

Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…