This paper presents a framework for utilizing Student Evaluations of Teaching (SET) in faculty evaluations. Recognizing the ongoing debate about the validity of SET as a measure of teaching effectiveness, the authors agree with scholars who propose viewing SET as a tool for gauging 'student perceptions of learning'. They present a method that…

Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

In this article, A. Adrienne Walker introduces the concept of person fit to education stakeholders as a source of evidence to inform the trustworthiness of a test score for interpretation and use (validity). Person fit analyses are used in educational measurement research to explore the degree to which a person's test score can be interpreted as a…

The article examines the tensions one superintendent in the USA experienced as he evaluated principals in a high-stakes environment that had undergone numerous transformations at the central office. Using qualitative methods, primarily, shadowing techniques, observations and debriefing, the following tensions emerged and were examined in light of…

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid evaluation and…

Background/Context: Two key uses of international assessments of achievement have been (a) comparing country performances for identifying the countries with the best education systems and (2) generating insights about effective policy and practice strategies that are associated with higher learning outcomes. Do country rankings really reflect the…

A study involving three individuals (ages 13-20) with developmental disabilities and problem behaviors examined the influential role that unanticipated idiosyncratic stimulus variables play in affecting the outcome of a functional analysis. Guidelines are discussed concerning when to suspect that idiosyncratic stimuli might be acting to influence…

A study compared the effects of different methods of analyzing trends to illustrate how failure to account for change in classification will lead to misinterpretation of data on the performance of students with disabilities. Data from five years of assessment in Texas is used to illustrate effects of classification changes. (Contains references.)…

This report summarizes results from research aimed at improving the quality of information collected about school curriculum. The research sought to design and pilot a model for collecting benchmark data on school coursework. These more indepth data, such as course textbooks, assignments, exams, and teacher logs, can serve as anchors against which…

The prevalent use of student ratings in teaching evaluations, particularly the reliability of such data, has been debated for many years. Reports in the literature indicate that there are many factors influencing student perceptions of teaching. Three of these factors were investigated at the University of Western Australia, namely the broad…

Studied ratings by Australian counseling psychology graduate students (N=38) and practicing counseling psychologists (N=40) of four hypothetical clients' mental health. Presented "good,""bad," and "neutral" information on each client and asked subjects to rate clients' on Global Assessment Scale. Found bad information…

In November 1992, the Ford Foundation published a study entitled "State Higher Education Systems and College Completion," which argued that states that relied heavily on community colleges in their postsecondary educational system, such as California, Florida, Illinois, Indiana, and Wisconsin, were not efficient in producing bachelor degree (BA)…