Background: Mid-semester evaluations are gaining traction as a means to gather evaluation data for formative purposes. However, it is not clear if course coordinators who conduct these evaluations are adequately equipped with evaluative knowledge and skills to guide them through their evaluative processes. Objectives: This study is a…

Diagnostic classification models (DCMs) classify examinees based on the skills they have mastered given their test performance. This classification enables targeted feedback that can inform remedial instruction. Unfortunately, applications of DCMs have been criticized (e.g., no validity support). Generally, these evaluations have been brief and…

Cost-effectiveness analysis is rarely used in education. When it is used, it often fails to meet methodological standards, especially with regard to cost measurement. Although there are occasional criticisms of these failings, we believe that it is useful to provide a listing of the more common concerns and how they might be addressed. Based upon…

The use of data to inform decisionmaking and practice at the school and district levels is now a common feature of reform efforts. Advances in districts' technological capacities have produced data systems that allow a flow of data to and from schools, often to the point of creating an overwhelming flood of information. To make the flow of…

Forty-two states and the District of Columbia have recently received waivers to the school accountability requirements of the No Child Left Behind Act (NCLB). As the prospects for reauthorizing the Act in the near term are dim, these new accountability systems will be law for at least several years. Drawing on a four-part framework from the…

The identification of children at-risk for reading problems can be costly and time-consuming. Previous research has indicated that teachers are relatively accurate in assessing children's overall reading ability. This study investigated the accuracy of kindergarten and first grade teacher rating scales in predicting children's reading…

The importance of higher education has never been clearer. Educational attainment--the number of years a person spends in school--strongly predicts adult earnings, as well as health and civic engagement. Yet relative to other developed nations, educational attainment in the United States is lagging, with young Americans who heretofore led the…

Examining evaluation theory in cultural context is an important component of evaluating theory; however, it is not the ultimate goal. The foundational element in good evaluation is validity, and appreciating the cultural location of evaluation theory is an important building block in the argument supporting multicultural validity. Multicultural…

This study investigates instructors' perceptions about strengths and weaknesses of a student ratings instrument employed in their university. The sample consisted of 357 instructors in a major Canadian university where each term students are required to complete an evaluation at the end of every course. Qualitative analyses of their written…

The formula is simple: Highly effective teachers equal student academic success. Yet, the physics of American education is anything but. Thus, the question facing education reformers is how can teacher effectiveness be accurately measured in order to improve the teacher workforce? Given the demand for objective, quantitative measures of teacher…

Assessments labeled as formative have been offered as a means to improve student achievement. But labels can be a powerful way to miscommunicate. For an assessment use to be appropriately labeled "formative," both empirical evidence and reasoned arguments must be offered to support the claim that improvements in student achievement can be linked…

This report describes the purposes of benchmark assessments and provides recommendations for selecting and using benchmark assessments--addressing validity, alignment, reliability, fairness and bias and accessibility, instructional sensitivity, utility, and reporting issues. We also present recommendations on building capacity to support schools'…

The study of the consequences of evaluation, or more specifically of evaluation use or utilization, represents a significant portion of the body of research on evaluation. Much has been written on the evolution of the multidimensional concept of evaluation use, most recently the examination of consequences of evaluation that are not a function of…

A discussion of current issues in evaluation, related to society's expectation that evaluation is based on scientific authority, is followed by an exploration of concepts of "validity" and "values." The role of the evaluator is increasingly involved in issues of ethics and social justice. (SLD)

In many school districts, the pressure to raise test scores has created overnight celebrity status for formative assessment. Its powers to raise student achievement have been touted, however, without attending to the research on which these claims were based. Sociocultural learning theory provides theoretical grounding for understanding how…