Over the last decade, the idea of societal impact resulting from publicly funded research has changed from being a relatively fringe concern related to high-technology entrepreneurship and spin-off companies to becoming an increasingly important public policy concern. This has stimulated academic science policy research to investigate the impact…

Rater training is necessary to accurately evaluate fundamental motor skills among children with developmental disabilities (DD). The purpose of this pilot study was to examine the impact of an online rater training program for novice raters on scoring accuracy of the run and two-hand strike skills on the Test of Gross Motor Development-Third…

This study employed a mixed-methods approach to examine how rater performance develops during a semester-long rater certification program for an English as a Second Language (ESL) writing placement test at a large US university. From 2016 to 2018, we tracked three groups of novice raters (n = 30) across four rounds in the certification program.…

Due to the diversity of steps to be followed in program evaluation and knowledge, skills, qualification and competency requirements, the evaluation should be a field of expertise similar to other disciplines. Thus, it is important to consider program evaluation as a field of expertise and to determine the required competencies. This study aimed to…

Drawing on Glenn Fulcher's extensive work in performance-based language assessment of speaking, this paper explores the assessment of L2 speaking ability in local language testing contexts. For that purpose, I review Fulcher's influential work that highlights the relationship between the speaking construct, the task, the performance, and the…

In the light of continuous change of global perspectives, current educational contexts have been evolving to cover the necessary 21st century skills that the individuals must acquire. Two of the 4Cs (creativity, critical thinking, collaboration and communication) of the 21st century educational trends; creativity and creative thinking are the key…

Over the last decade, teacher evaluation has moved onto center stage in efforts to strengthen schooling. In this article, we address the question of whether focusing on this administrative process is likely to accomplish what reformers hope. We answer that question by examining the available evidence, both direct and indirect. We deepen the…

Joseph S. Wholey is Professor Emeritus in the University of Southern California's (USC) School of Public Policy, Planning, and Development. He received his BA from Catholic University, Phi Beta Kappa and his MA in mathematics and PhD in philosophy from Harvard University. His work focuses on the use of strategic planning, performance measurement,…

The Benjamin Banneker Scholars Program (BBSP) was designed at an HBCU to increase the academic performance, retention, and graduation of minority students in science, technology, engineering and mathematics (STEM). At the end of each academic year, students completed a BBSP Post-Program Satisfaction Survey. Each year Mentoring was consistently…

Focus on social and emotional intelligence competencies to improve effective leadership has become commonplace in the corporate arena and is now considered by many a prerequisite to successful job performance and outcomes (Antonakis, Ashkanasy, & Dasborough, 2009; Grant, Curtayne, & Burton, 2009; Spence & Grant, 2007; Kampa-Kokesch…

Nearly all private, government and non-governmental organizations that receive government funding to run social or health promotion programs in the United States are required to conduct program evaluations and to report findings to the funding agency. Reports are usually due at the end of a funding cycle and they may or may not have an influence…

Although the importance of addressing and evaluating treatment and program fidelity is clearly emphasized in the literature on psychology, education, and health, little attention has been given to fidelity in adventure literature or research. Program fidelity refers to whether or not, and how well, a specific intervention or program was…

Mathematics Recovery (MR) is designed to identify first graders who are struggling in mathematics and provide them with intensive one-to-one tutoring. We report findings from a 2-year evaluation of MR conducted in 20 elementary schools across five districts in two states. The design allowed for the estimation of the counterfactual growth…

Making the program theory explicit is an essential first step in Theory Driven Evaluation (TDE). Once explicit, the program logic can be established making necessary links between the program theory, activities, and outcomes. Despite its importance evaluators often encounter situations where the program theory is not explicitly stated. Under such…

This study examines family child care providers' perspectives regarding effective professional development and their role in the early learning and care system. Four focus groups were conducted annually for 3 years involving a total of 54 licensed family child care providers. Supportive social relationships emerged as an important dimension of…