In this article, the authors discuss the technologies of normalization and self in relation to ethics and the problematization of extrinsic research ethics. They argue that institutional review boards (IRBs) and other similar institutional mechanisms promote extrinsic forms of ethics that are exemplified through institutionalized structures such…

Expert committees are frequently called into institutions to analyse the status quo and make recommendations for improvement or change. This is so within the fields of medicine and law, and increasingly so within the field of education, and higher education in particular. Little is known, however, about the mechanisms at work within such expert…

Needs assessment (NA) is generally based on the discrepancy between two conditions--the desired and present states. To date, there has not been an extensive research regarding a number of subtle problems in discrepancy analysis. One such example is missing data for one or both the two states. This leads to highly varied item "n's" for calculating…

This article describes an innovative data collection procedure. A subsample (n = 164) of a longitudinal research project was assessed using a bank-issued check survey procedure (a removable bank check on which response fields were printed). Using the new procedure, parents returned their surveys simply by depositing or cashing their incentive…

The necessities and benefits of reflexivity are now well laid out in the broader social science literature, and the American Evaluation Association's (2004) "Guiding Principles for Evaluators" identify reflective practices that evaluators are expected to carry out. This article uses the context of the university classroom and a writing sample to…

Many approaches to standard-setting use item calibration and student score estimation results to structure panelists' tasks. However, this requires collecting standard-setting judgments after the item analysis results are available. The Scoring Guide Alignment approach collects standard-setting judgments during the scoring sessions from teachers…

The purpose of the current study was to analyze the relationship between automated essay scoring (AES) and human scoring in order to determine the validity and usefulness of AES for large-scale placement tests. Specifically, a correlational research design was used to examine the correlations between AES performance and human raters' performance.…

This fact sheet summarizes data gathered in the 2010 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by EvaluATE, the evaluation resource center for the ATE program located at The Evaluation Center at Western Michigan University, this was the eleventh annual survey of ATE projects and…

The purpose of this Guide is to provide education officials, program providers, and others seeking to sponsor a rigorous program evaluation with practical advice on finding a capable evaluator. More specifically, this Guide offers practical advice on finding an evaluator to conduct a rigorous evaluation to measure the effect of an educational…

Background: Over the past four decades there have been a number of controversies arising from the discussion of "equity" and "equality". These concepts are often invoked by policy analysts, policy-makers, government officials and scholars in order to justify or critique resource allocation to different levels of the educational system. Purpose: By…

Use of evaluation findings is a valued outcome for most evaluators. However, to optimize use, the findings need to be disseminated to potential users in formats that facilitate use of the information. This reflective case narrative uses a national evaluation of a multisite National Science Foundation (NSF) program as the setting for describing the…

Taking the position that science is not value-free has certain consequences. There are both risks and rewards inherent when evaluators relinquish an objective, non-involved role for a more subjective, partisan role in an evaluation where issues of class, gender, and race are intertwined. It is important for evaluators to consider how their…

This study is an in-depth investigation of the National Board for Professional Teaching Standards (NBPTS) bias-reduction training, from the perspective of assessors. The research examined how successful the bias training was in guiding assessors to recognize their biases and to identify actions to be used to reduce the impact of bias on their…

The making of a decision implies a choice between competing alternative solutions. In a decision-making context including multiple criteria, the criteria (or their related variables) are placed in relation to each other. This provides a comparison to some fixed point or origin, reducing the problem to one which can be solved by optimization as in…

The Louisiana Board of Elementary and Secondary Education has adopted the following quality assurance and control policies for education program evaluation in Louisiana: (1) anyone who accepts and executes responsibility for planning, conducting and reporting evaluations of educational programs, projects, and materials approved by the State Board…