Many seem to believe that researcher-made tests are unnecessary, if not inappropriate, for evaluating reading comprehension interventions. We suggest that this view reflects a zeitgeist in which researcher-made (proximal) tests that align with the researchers' interventions are closely scrutinized and often devalued, whereas commercially developed…

Compared to average workers in the United States, teachers exhibit higher levels of job-related stress, with roughly half of teachers showing signs of burnout. For policymakers and school leaders, some promising levers to lower teacher burnout are salaries, work schedules, and working conditions. This brief describes the findings of a new impact…

In multisite trials, learning about treatment effect variation across sites is critical for understanding where and for whom a program works. Unadjusted comparisons, however, capture "compositional" differences in the distributions of unit-level features as well as "contextual" differences in site-level features, including…

The purpose of this report is to provide readers with a comparative analysis of the Massachusetts workforce "system" structures and performance reporting processes compared to other states. Though the federal workforce development system is often examined in its entirety and individual state systems are at times examined independently,…

As part of its "Guiding Principles for Evaluators," the American Evaluation Association (AEA) requires that evaluators develop cultural competencies. Using a successive-independent-samples design, the researchers sought to compare perceptions of cultural competence across a duration of 10 years. Qualitative data were collected via online…

Purpose: The purpose of this paper is to evaluate two coaching and mentoring programmes focused on the ever-increasingly important aim of enhancing the chances of professional level employment for undergraduate students, at two UK universities. In addition, to offer recommendations to enhance coaching and mentoring success within higher education…

In multisite trials, learning about treatment effect variation across sites is critical for understanding where and for whom a program works. Unadjusted comparisons, however, capture "compositional" differences in the distributions of unit-level features as well as "contextual" differences in site-level features, including…

Scholarship on the role of professional development opportunities for undergraduate students has highlighted the growing importance of internship programs. Different designs of internship programs have emerged as their numbers proliferate. Internship programs vary on key dimensions including integration of academic content, development of…

In this article, we present a reconceptualization of sport as a series of collaborative contests with players on different teams scoring goals cooperatively: players on both sides lose or both sides win together depending on whether they can improve the scores they earn in overcoming limitations and obstacles by working with the other team. When…

Given the widespread use of non-experimental (NE) methods for assessing program impacts, there is a strong need to know whether NE approaches yield causally valid results in field settings. In within-study comparison (WSC) designs, the researcher compares treatment effects from an NE with those obtained from a randomized experiment that shares the…

The Illinois Educator Preparation Profiles (IEPP) system, housed at the Illinois State Board of Education (ISBE), provides public information on the performance of Illinois teacher preparation programs (TPPs) across the state. TPPs are scored on 11 indicators grouped into four domains--candidate selection and completion, knowledge and skills for…

It is a matter of concern when large, federally funded programs are evaluated using designs that produce misleading information. In this article, we discuss problems associated with an evaluation design that was adopted by the U.S. Department of Education, Office of Special Education Programs (OSEP) to document the performance of a major early…

This article compares and evaluates the music components of the International Baccalaureate (IB) Primary Years Programme (PYP) and the NSW Creative Arts K-6 Syllabus. To guide the analysis, this article employs Bernstein's (1971) concepts of classification and frame, and the two levels of 'best practice' in primary music education proposed by…

Researchers continue to be interested in the evaluation of early childhood education programmes, their interventions, and the implementation of different types of evaluation. Their interest continues to increase and attract other researchers. In understanding the nature and appropriate use of evaluation in early childhood education and the basis…

Effective teacher evaluations serve the dual function of being both summative and formative (Danielson & McGreal, 2000). The current evaluation tool in Virginia uses a traditional approach of incorporating standardized test scores as forty percent of a measure of teacher effectiveness. By way of a literature review, this article applies a…