Assessment of learning has become very important for government, universities and accrediting agencies. In this article, two variables are examined, leadership and teamwork, in the context of a survey used by one mid-south university for assessment purposes. This survey demonstrates the problems that arise when the sequential steps of the research…

Measurement of affective states in everyday life is of fundamental importance in many types of quality of life, health, and psychological research. Ecological momentary assessment (EMA) is the recognized method of choice, but the respondent burden can be high. The day reconstruction method (DRM) was developed by Kahneman and colleagues ("Science,"…

Despite a broad theoretical literature on multidimensional inequality and a widespread belief that welfare is not synonymous to income--not the least in a developing context--empirical inequality examinations rarely includes several welfare attributes. We explore three techniques on how to evaluate multidimensional inequality using Zambian…

Schools and school systems throughout the nation are increasingly experimenting with using various instructional technologies to improve productivity and decrease costs, but evidence on both the effectiveness and the costs of education technology is limited. A recent report published by the Thomas B. Fordham Institute sets out to describe "the…

Purpose: The use of e-learning is largely predicated upon the assumption that it can facilitate improvements in student learning and therefore can be more effective than conventional techniques. This assumption has been supported by some in the literature but has been questioned by a continuing body of contrary or indifferent evidence. The purpose…

Among the varied analytical challenges institutional researchers face, examining faculty pay may be one of the most vexing. Although the literature on faculty compensation analysis dates back to the 1970s (Loeb and Ferber, 1971; Gordon, Morton, and Braden, 1974; Scott, 1977; Braskamp and Johnson, 1978; McLaughlin, Smart, and Montgomery, 1978),…

Examines difficulties with citation analysis as it is used to study citation frequency, usually for the evaluation of scientists, publications, or institutions. Topics addressed include selection of a control set of papers, comparisons of different types of papers (e.g., methodological or theoretical), effects of independent variables, and use of…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

The authors question Burgoon's assumption that the acquisition of grades and the achievement of course goals are highly positively correlated. The major criticisms of Burgoon's study concern use of grades as measurements of success and the nature of the experimental population. The use of grades is criticized on the grounds that disparity existed…

This paper reviews both the content and the methodological issues involved in the small but growing number of empirical studies on the use of Direct Instruction programs and teaching procedures with special populations. The research reviewed includes experimental and quasi-experimental work, summative evaluations of entire programs, and…

The difficulties in evaluating bilingual education appear to have prevented success in all but a few evaluation attempts, but better and more meaningful evaluation is neccessary in order to identify the strengths and weaknesses of bilingual programs. Many bilingual programs are undergoing constant modification, adequate assessment instruments have…

Discusses the effectiveness of computer mediated communication (CMC) in higher education. Highlights include a review of pertinent literature; factors associated with successful CMC resources; activity theory; helping users establish a shared purpose; methodological problems; evaluation methods; a conferencing system; and the patterns and content…

Despite questions about their reliability and validity, student evaluations of teaching (SETs) are a primary measure of instructor performance. The current study examines SETs, including a thorough list of potentially relevant variables. The findings suggest that how much students perceive they learned in a course is an important predictor of SET…

There is a continuing need in evaluation research for the establishment of a relationship between evaluation findings and decision making. A method is proposed for a particular situation: annual funding decisions for projects in a large grant program in vocational education. Outcome and predictive impact variables were ranked by three groups of…