Between 2012 and 2016, the Learning Metrics Task Force (LMTF) laid out an ambitious agenda for nations and the international community on how to define and measure learning in the context of the United Nations Sustainable Development Goals (SDGs). This report describes the process undertaken by a group of 15 "Learning…

This literature review explores current post-secondary practices for evaluating online instructors. As enrollment of students in online courses has steadily increased over the last few decades, instructor evaluation has lagged behind. Through a thematic analysis of existing literature, this review seeks to answer these questions: (1) How are…

Proliferation of prescriptive models in an "engineering" field is not a sign of its maturity. Quite the opposite. Materials engineering, for example, meets the criterion of parsimony. Sadly, the very large number of models in "instructional design," putatively an engineering field, raises questions about its status. Can the…

Assessment can be defined as any method through which one gathers data or information about something. Assessing may incorporate measurement and testing, but it also includes evaluation and appreciation of creative products, processes, and performances. It encompasses finding out much more information than test results alone can give. Creative…

In this paper, we describe the design, development, and initial validity evidence for the Screening to Assign Accommodations Tool (SAAT). The purpose of the SAAT is to identify students for whom construct irrelevant variance (CIV) might obscure measurement of their knowledge, skills, and abilities in mathematics. Once students are identified as…

In the original paper, it was argued that while there is an array of methods and methodologies available, their use is delimited by the culture of accountability that prevails in public sector institutions, a fact that is particularly problematic given the complexity and diversity of evaluation contexts today. This short rejoinder, to responses…

In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

This article discusses a project undertaken to assess the journals in a Big Deal package by applying a weighted value algorithm measuring quality, utility, and value of individual titles. Carried out by a national library consortium in Canada, the project confirmed the value of the Big Deal package while providing a quantitative approach for…

Background: Return on investment (ROI) is one of the most popular evaluation metrics. ROI analysis (when applied correctly) is a powerful tool of evaluating existing information systems and making informed decisions on the acquisitions. However, practical use of the ROI is complicated by a number of uncertainties and controversies. The article…

In this paper, we report on a study to quantify the impact on student learning and on student assessment literacy of a brief assessment literacy intervention. We first define "assessment literacy" then report on the development and validation of an assessment literacy measurement instrument. Using a pseudo-experimental design, we…

Never before in the history of the teaching profession has there been such a need for comprehensive evaluation of all teacher preparation programs, most especially professional development schools (PDSs). This need is driven not only by the pressures of the age of accountability, but also by the need for the PDS movement to act ethically and…

Measures assessing the quality of children's environments and interactions in nonparental care settings were developed originally for use in child care research and as self-assessment tools for practitioners. Within the last decade, these measurement tools have moved into the public policy arena, where they are now used to make programmatic…

The formula is simple: Highly effective teachers equal student academic success. Yet, the physics of American education is anything but. Thus, the question facing education reformers is how can teacher effectiveness be accurately measured in order to improve the teacher workforce? Given the demand for objective, quantitative measures of teacher…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

Teacher evaluation has emerged as a major focus for reform at the highest levels of education policymaking, and for good reason. Most evaluations are based on scant evidence of actual effectiveness, produce inflated ratings, and provide teachers with little useful feedback. This paper offers policymakers and practitioners important "lessons…