A major obstacle to developing evidenced-based policy is the difficulty of implementing randomized experiments to answer all causal questions of interest. When using a nonexperimental study, it is critical to assess how much the results could be affected by unmeasured confounding. We present a set of graphical and numeric tools to explore the…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

This meta-analysis examined the influence of attributes related to the implementation of learning strategy instruction interventions on students' academic performance, and also examined how the attributes related to the method of testing the intervention effects affected the actual effects measured. Using metaregression, we analyzed the…

The article reports results from a Human Early Learning Partnership initiative that aims to address limitations within the literature concerning neighborhood effects on child development. Problems include the tendency for studies to (a) rely on small samples of children, (b) focus on high-risk populations, (c) define neighborhood by Census…

This paper reports on the factors that characterize high-utilization evaluations. It is based on materials submitted to an American Educational Research Association (AERA) Division H competition for outstanding examples of evaluation utilization. The paper is organized into three sections. The first section outlines the background of the study:…

Surveys public relations practitioners in higher education. Finds that characteristics of individuals, not structural or environmental factors, were significant predictors of systematic research. Concludes that practitioners who are graduates of public relations programs can have an influence on the research of the field, especially when they work…

This paper investigates relationships between candidate and examiner characteristics, the texts of examiner reports on Ph.D. theses and examiner recommendations made on theses. The data were related to 804 examiner reports on 301 theses submitted at three Australian universities. Thesis topics ranged across ten Broad Fields of Study or discipline…

Two studies of the oral secondary school leaving examinations in Germany indicated variances in ratings made by different teachers. The differences were significantly influenced by speed of speaking, background information about past achievement, and contrast of performance related to sequence of presentation. (Author/MJL)

Evaluation can serve a variety of educational management questions, but an administrator's ability to use evaluation as a management tool depends not only upon his or her own perception of evaluation but also on the perceptions of other potential evaluation users in the system. Research has uncovered a variety of factors influencing an…

Possible relationships between five test examiner characteristics (gender, race, tenure, experience as a test administrator, and experience as a test developer or scorer) and six student achievement scores (reading, writing, language usage, mathematics, science, and social studies) were studied at the school level in a statewide assessment. The…

Despite questions about their reliability and validity, student evaluations of teaching (SETs) are a primary measure of instructor performance. The current study examines SETs, including a thorough list of potentially relevant variables. The findings suggest that how much students perceive they learned in a course is an important predictor of SET…

After outlining the 1984 activities and results of the Center for the Study of Evaluation's (CSE's) Evaluation Productivity Project, this monograph presents three reports. The first, "The Administrator's Role in Evaluation Use," by James Burry, Marvin C. Alkin, and Joan A. Ruskus, describes the factors influencing an evaluation's use…