Sociology faculty are accountable to multiple stakeholders to demonstrate that our academic programs are effective and that students are learning. Despite the ubiquity of mandated program review practices, which often include the assessment of student learning, research is lacking on the extent to which these efforts lead to improvements in…

Distractor analyses are routinely conducted in educational assessments with multiple-choice items. In this research report, we focus on three item response models for distractors: (a) the traditional nominal response (NR) model, (b) a combination of a two-parameter logistic model for item scores and a NR model for selections of incorrect…

Within their teacher preparation courses and field experiences, preservice teachers are introduced to numerous instructional practices, not all of which are considered research-based. For this reason, instruction in how to evaluate the effectiveness of one's practices is essential, but it is often a lacking component of initial certification…

Large-scale assessment (LSA) is a tool used by education authorities for several purposes, including the promotion of teacher-based instructional change. In Canada, all 10 provinces engage in large-scale testing across several grade levels and subjects, and also have the common expectation that the results data will be used to improve instruction…

Education systems are increasingly creating rich, longitudinal data sets with frequent, and even real-time, data updates of many student measures, including daily attendance, homework submissions, and exam scores. These data sets provide an opportunity for district and school staff members to move beyond an indicators-based approach and instead…

This resource is part of a series of reports about challenges facing statewide science assessments and innovative solutions states are enacting to meet those challenges. Deciding to implement a system of assessments is a critical step toward ensuring that all students are getting the high-quality science education they need--but it is also…

In light of the emergence of statistical analysis techniques based on data mining in education sciences, and the potential they offer to detect non-trivial information in large databases, this paper presents a procedure used to detect factors linked to academic achievement in large-scale assessments. The study is based on a non-experimental,…

This qualitative, action-research study used themes from appreciative interviews of Texas elementary teachers to recommend a framework for a school-wide assessment model for a Texas elementary school. The specific problem was that the Texas accountability system used a yearly measurement that failed to track progress over time and failed to…

This article explores the initial results produced by the European Commission's "better regulation agenda", which aims to stimulate productivity and employment, on the use of evidence and its potential to enhance democratic governance. The article finds that implausible rational models of policy making dictate the ways in which the…

Key system challenges identified by the Abu Dhabi Education Council provided the impetus for an aggressive strategic plan as necessary guidance and support for the development of the P-12 education system to contribute to advancing its positioning in the global knowledge economy. For the Abu Dhabi Education Council, the analysis served as a tool…

In this paper we present a model of collaborative evaluation that has been used to engage teachers in data-based decision making for improving teaching and learning in mathematics and science. We examine three external challenges that threaten the process of continuous school improvement; namely, making sense of data, policy changes, and…

Education reform has been on a new path over the last 15 years; a path that leads to more accountability, more choice for students and parents, highly qualified teachers, as well as, best practices in instruction. In an effort to move along the path of reform and as a result of previous reform, the 2004 reauthorization of IDEA reviewed the field…

There are three purposes for evaluation: evaluation for action to aid the decision making process, evaluation for understanding to further enhance enlightenment and evaluation for control to ensure compliance to standards. This article argues that the primary function of evaluation in the "Catherine Wheel" computer-based assessment (CBA)…

The emerging concept of program theory and its function in program evaluation practice is the central focus of this paper. It appears that the traditional decision/adoption model, when considered in conjunction with the institutionalized beliefs, values, and methodological procedures of the state Cooperative Extension Services, meets the criteria…

This synthesis of the evaluation process in education presents a matrix illustrating the dimension of a continuum of models in their degree of relationship to a decision made. A second dimension categorizes models by their described process components. Extant models are seen as basically the same in slightly different language, and their…