The term measurement disturbance has been used to describe systematic conditions that affect a measurement process, resulting in a compromised interpretation of person or item estimates. Measurement disturbances have been discussed in relation to systematic response patterns associated with items and persons, such as start-up, plodding, boredom,…

Robert Stake presents his views on responsive evaluation, naturalistic approaches to evaluation, the role of testing in evaluation, and the training of evaluators. (BW)

Ways to use standard-setting data to adjust cutoff scores on examinations are reviewed. Ten sources of information to be used in determining standards are listed. The decision to modify passing scores should be based on these types of information and consideration of adverse impact or rating process irregularities. (SLD)

Describes some forces that have shaped current attitudes toward evaluation of education, presents five guidelines to help in discussions of assessment, and charges teachers with the responsibility of making evaluation effective. (DF)

Possible sources of intrajudge inconsistency in standard setting are reviewed, and approaches are presented to improve the accuracy of rating. Procedures for providing judges with feedback through discussion or computerized communication are discussed. Monitoring and maintaining judges' consistency throughout the rating process are essential. (SLD)

Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)

This research focuses on the examination of problems related to the national teacher performance appraisal system by the Thai Ministry of Education. It highlights major problems of the current performance appraisal system by delineating the weaknesses and pitfalls of the current appraisal system. The findings indicate problems to three major…