Much time is invested by markers in providing feedback to students that is personalised, aimed at providing them with information to feed forward into their next piece of work. Given the investment of time by tutors in the feedback process, we were necessarily concerned with how it is used by students and keen to explore and develop practice. This…

Discusses the misuse of evaluation by exploring the ethics of those using the evaluation. Characterizes various misuse situations, including financial misuse, and provides insight into why misuse of evaluation takes place. (SLD)

Online education is the fastest growing form of course delivery of higher education in the United States. It has revolutionized how students and instructors interact in the educational process. Yet students in online courses continue to experience higher attrition rates than their counterparts in traditional face-to-face classes despite the…

Based on the results of a generalizability study of measures of teacher knowledge for teaching mathematics developed at the National Center for Research on Evaluation, Standards, and Student Testing at the University of California, Los Angeles, this article provides evidence that teachers are better at drawing reasonable inferences about student…

This paper concentrates on the public and formal processes of reporting achievement. The topic is significant because employers, managers and graduate schools all use warrants when making selection and governance decisions. Should those warrants turn out to have, as we argue, local meanings, then selection and governance practices, amongst others,…

The proposed model for vocational education evaluation is based on an instrumental/incremental definition of evaluation utilization and various subject-specific influences on utilization. Critical components are the identification of issues for vocational education and the application of a dynamic cycle of evaluation for linking evaluation…

Explores the problems of theory-based evaluation, describes the nature of potential benefits, and suggests that the benefits are significant enough to warrant continued effort to overcome the obstacles and advance its use. Many of the problems are related to inadequate theories about pathways to desired program outcomes. (SLD)

Offers a vision of responsiveness as the political inclusion of marginalized human service providers and end users through one evaluator's critical and sustained efforts to enact this vision in practice. Discusses difficulties in the active inclusion of the critical reference group, usually service users, in evaluation. (SLD)

Provides a conceptual framework for considering the distinction between evaluation use and evaluation influence and the relationship between evaluation use and knowledge use. Clarifies and expands some of the established definitions of concepts related to evaluation use. (SLD)

Describes a utilization-focused evaluation "gone awry" when two of the primary intended users left the program and were replaced. Discussion centers on the potential choices for use when intended users are no longer part of an evaluation. (SLD)

The role of the evaluator in insuring utilization and quality of evaluation results is discussed. Topics covered include a utilization-focused vision of accountability, overcoming staff fears of evaluation, eliciting the right information from users, situational responsiveness, and advocacy. (TJH)

Presents an integrated theory of evaluation influence that is broader than previous constructs of use and includes the dimensions of source, intention, and time. The resulting framework addresses process-based use and results-based use; intended and unintended use; and episodic and instrumental use. (SLD)

"Building Institutional Capacity for Data-Informed Decision Making" is the third installment of the Cutting Edge series, which aims to help colleges engage faculty, scale successful interventions, and create a strong culture of evidence through use of data to strengthen their institutional change and student success efforts. Though the…

Assessments labeled as formative have been offered as a means to improve student achievement. But labels can be a powerful way to miscommunicate. For an assessment use to be appropriately labeled "formative," both empirical evidence and reasoned arguments must be offered to support the claim that improvements in student achievement can be linked…

This report describes the purposes of benchmark assessments and provides recommendations for selecting and using benchmark assessments--addressing validity, alignment, reliability, fairness and bias and accessibility, instructional sensitivity, utility, and reporting issues. We also present recommendations on building capacity to support schools'…