Robert Stake presents his views on responsive evaluation, naturalistic approaches to evaluation, the role of testing in evaluation, and the training of evaluators. (BW)

An accepted criterion for gauging the fairness of examinees' scores, derived from judge-awarded ratings, has been the size of the correlation between the judges and the inter-rater reliability. Various means of achieving inter-rater reliability were reviewed, and a model to measure inter-rater reliability is forwarded. Both theoretical and…

This study illustrates the use of three least-squares models to control for rater effects in performance evaluation: (1) ordinary least squares (OLS); (2) weighted least squares (WLS); and (3) OLS subsequent to applying a logistic transformation to observed ratings (LOG-OLS). The three models were applied to ratings obtained from four…

In the Dutch national examinations, reading comprehension tests are used for all languages. For the native language, reading comprehension is tested with reading passages and related questions to which the test-taker provides his own response, not choosing from a group of alternatives. One problem encountered in testing with these items is…

Oregon has recognized the problems involved in the evaluation of Elementary Secondary Education Act Title I programs, and has worked toward solutions, while recognizing the differing needs of local, state, and federal departments of education. In order to provide help to the local school districts with respect to evaluation, a statewide committee…