Evaluation use is a complex, iterative process involving diverse stakeholders and activities. Factors influencing evaluation use has long been discussed, however, little is known about current conceptualizations evaluation use including what counts as use, what encourages use, and how to measure use. Following two previous scoping reviews, we…

COVID-19 is disrupting assessment practices and accelerating changes. With special focus on K-12 and credentialing exams, this article describes the series of changes observed during the pandemic, the solutions assessment providers have implemented, and the long-term impact on future practices. Additionally, this article highlights the importance…

Despite marked growth in evaluation use and capacity in the U.S. Federal Government over the last 50 years, the levers that have driven institutional change have not previously been identified. This ethnographic study mapped the process and factors that have led to the diffusion of value in evaluation in the U.S. Federal Government. Analyses of…

Grounded in the renewed focus on research on evaluation (Coryn, Noakes, Westine, & Schröter, 2011; Mark, 2007; Peck, Kim, & Lucio, 2012), which is motivated, in part, by a desire for evidence-informed practice, this paper calls attention to the need to discern larger patterns across studies. It argues that without clarity and consistency…

Imagine a student using an intelligent tutoring system. A researcher records the correctness and time of each of your attempts at solving a math problem, nothing more. With no names, no birth dates, no connections to the school, you would think it impossible to track the answers back to the class. Yet, class sections have been identified with no…

In early 2015, the Reform Support Network brought together State department of education leaders from Colorado, Delaware, New Jersey and Tennessee to discuss strategies for refining and sustaining high-quality educator evaluation systems. During the convening, representatives from the Tennessee Department of Education (TDOE) explained how the…

The current age of standardization and accountability in education presents a need for educators to be proficient consumers and producers of data. To understand what mathematics teachers see as the purpose of data and assessment, as well as their perceived needs in these areas, we administered a survey to all mathematics teachers in two school…

This paper gathers descriptions on the use of the International Adult Literacy Survey (IALS) and essential skills cross Canada. IALS was developed as a population measure to lay out the distribution of skills and their relationship to other social and economic attributes. The information was taken from federal, provincial, and territorial…

Few arguments about education are as effective at galvanizing public attention and motivating political action as those that compare the performance of students with their counterparts in other countries and that connect academic achievement to economic performance. Because data from international large-scale assessments (ILSA) have a powerful…

The absence of differentiated instruction in many classrooms stifles success for students who do not learn the same way as their peers. Providing teachers with the knowledge and tools to differentiate in their classrooms may increase test scores and help low achieving students find success, while expanding the learning growth of gifted and…

Test developers are responsible to define how test scores should be interpreted and used. The No Child Left Behind Act of 2001 (NCLB) directed the Secretary of Education to use results from the National Assessment of Educational Progress (NAEP) to confirm the proficiency scores from state developed tests. There are two sets of federal definitions…

This study explored how teachers and school administrators connect large-scale assessment results with school improvement planning. Using a semi-structured format, 20 teachers and 18 administrators were interviewed from two school districts in southern Ontario, Canada. The interview protocol contained a range of questions related to teaching and…

This qualitative study explored how employees learn from Team Primacy Concept (TPC) based employee evaluation and how they use the feedback in performing their jobs. TPC based evaluation is a form of multirater evaluation, during which the employee's performance is discussed by one's peers in a face-to-face team setting. The study used Kolb's…

The role of the evaluator in insuring utilization and quality of evaluation results is discussed. Topics covered include a utilization-focused vision of accountability, overcoming staff fears of evaluation, eliciting the right information from users, situational responsiveness, and advocacy. (TJH)

The misuse of evaluation is discussed. Boundaries of misutilization are not well understood, and distinctions between misutilization and non-use or abuse are not clear. In general, the responsibility for evaluation misuse is with the user, while the responsibility for misevaluation is with the evaluator. A distinction is also needed between…