Traditional methods for preparing systematic reviews and syntheses of effectiveness studies rely on a limited set of methodological criteria to include studies that measure and report effects too narrowly to forward the mission of evidence-based practice. This article discusses why and how the criteria for study selection, evidence screening, and…

As states and communities invest in initiatives to improve the quality of early care and education, the measurement of quality is becoming more widespread and the importance of measuring quality well is gaining increasing attention. Within the broad context of interest in improving quality, this report seeks to differentiate among a number of…

Measures assessing the quality of children's environments and interactions in nonparental care settings were developed originally for use in child care research and as self-assessment tools for practitioners. Within the last decade, these measurement tools have moved into the public policy arena, where they are now used to make programmatic…

This article examines the power analyses for the first wave of group-randomized trials funded by the Institute of Education Sciences. Specifically, it assesses the precision and technical accuracy of the studies. The authors identified the appropriate experimental design and estimated the minimum detectable standardized effect size (MDES) for each…

This article describes a research-driven heuristic for the scholarly evaluation of teaching and learning interventions, which is systematic, collaborative, and discipline focused. We offer this guide to educational developers and other instructional support staff who are tracking the impact of interventions in teaching and learning with academic…

The Wechsler Abbreviated Scale of Intelligence (WASI; Psychological Corporation, 1999) and the Wide Range Intelligence Test (WRIT; Glutting, Adams, & Sheslow, 2000) are two well-normed brief measures of general intelligence with subtests purportedly assessing verbal-crystallized abilities and nonverbal-fluid-visual abilities. With a sample of…

In recent years, procedures have been established in Flanders for "Prior Learning Assessment" (PLA) outside the formal learning circuit, of which the portfolio is a regular component. In order to maximize the possibilities of acknowledgement of prior learning assessment, the Flemish government is looking for a set of common criteria and…

This paper presents the results of a cross-sectional survey on evaluation use completed by 1,140 U.S. American Evaluation Association members. This study had three foci: evaluators' current attitudes, perceptions, and experiences related to evaluation use theory and practice, how these data are similar to those reported in a previous study…

Determining evidence-based practices is a complicated enterprise that requires analyzing the methodological quality and magnitude of the available research supporting specific practices. This article reviews criteria and procedures for identifying what works in the fields of clinical psychology, school psychology, and general education; and it…

The authors develop an original measure of learning in higher education, based on grades in subsequent courses. Using this measure of learning, they show that student evaluations are positively related to current grades but unrelated to learning once current grades are controlled. They offer evidence that the weak relationship between learning and…

In order to promote the sustained and healthy development of teaching evaluation work, five changes should be brought about in the evaluation of the level of undergraduate teaching at China's institutions of higher education: Change teaching evaluation from a specific item of work to a system of a long-term and normative nature; change teaching…

A questionnaire investigation of academic staff and teaching administrators at Shanghai Normal University and Shanghai Fisheries University shows that the evaluation of the standards of undergraduate teaching work has had positive effects on teaching work and that setting up an evaluation system is an effective measure for assuring the quality of…

In educational effectiveness research, multilevel data analyses are often used because research units (most frequently, pupils or teachers) are studied that are nested in groups (schools and classes). This hierarchical data structure complicates designing the study because the structure has to be taken into account when approximating the accuracy…

Despite the growing knowledge base on evidence-based practices in social work and medicine, there is a large gap between what is known and what is consistently done. Implementation research is the study of methods to promote the uptake of research findings into routine practice. In this article, we describe the rationale for implementation…

This research investigated levels of moral judgment among public elementary school principals as measured by the Defining Issues Test Version 2 for occupationally relevant and other moral dilemmas. The participants scored lower (38.7) than the predicted average P score (postconventional thinking) for individuals who have attained graduate level…