Angoff-based standard setting is widely used, especially for high-stakes licensure assessments. Nonetheless, some critics have claimed that the judgment task is too cognitively complex for panelists, whereas others have explicitly challenged the consistency in (replicability of) standard-setting outcomes. Evidence of consistency in item judgments…

The Sustainability Rubric for Local Educational Agencies is a tool for LEAs to use in assessing the sustainability of any reform initiative (for example, implementing an educator effectiveness system). The rubric introduces a succinct description of the three primary categories of sustainability: context for sustaining reform, system capacity and…

The Sustainability Rubric Summary for Local Educational Agencies is a condensed version of the full rubric [see ED611412]. It provides an overview of the rubric's purpose; the categories, elements, and variables of sustainability; and the guiding questions to consider. This brief document is intended to be used for reference throughout your…

This article discusses regression effects that are commonly observed in Angoff ratings where panelists tend to think that hard items are easier than they are and easy items are more difficult than they are in comparison to estimated item difficulties. Analyses of data from two credentialing exams illustrate these regression effects and the…

Purpose: The recognition of practice in online instruction is still subject to interpretation and different approaches as a result of the rapid changes in technology and its effect on society. The purpose of this paper is to address these differences through a synthesis that can be easily accessed and consulted by educators in the field of…

This paper focuses on the use of evaluation criteria and rubrics as tools for training in an audiovisual translation mode: subtitling for the D/deaf and the hard of hearing (SDH). Following an introduction to the current conception of and research carried out on quality assurance and assessment both in the translation industry and academia, a…

In this study, we define the term "screener test," elaborate key considerations in test design, and describe how to incorporate the concepts of practicality and argument-based validation to drive an evaluation of screener tests for language assessment. A screener test is defined as a brief assessment designed to identify an examinee as a…

The University of Reading Learning Gain project is a three-year longitudinal project to test and evaluate a range of available methodologies and to draw conclusions on what might be the right combination of instruments for the measurement of Learning Gain in higher education. This paper analyses the validity of a measure of critical thinking…

This mixed methods study investigates the juncture of dance science, somatics, and contemporary modern dance training, and how they intertwine with learning processes and skill execution through transfer theory. The effects of a novel somatics training program are analyzed through six case studies using data reduction and interpretation of…

The Discrete Option Multiple Choice (DOMC) item format was introduced by Foster and Miller (2009) with the intent of improving the security of test content. However, by changing the amount and order of the content presented, the test taking experience varies by test taker, thereby introducing potential fairness issues. In this paper we…

In this article, the authors report on the results of a three-year study they conducted on assessment practices in general education courses at Duke University as part of a three-institution (Duke, the University of Kansas, and the University of Nebraska) research project funded by the Spencer Foundation. At all three institutions, researchers…

In this paper the author introduces a very practical model to guide school leaders/managers into supporting parental involvement and engagement in their schools. The model is called the Dual Navigation Approach (DNA). This rubric is based on six meta-analyses that he conducted over the last fifteen years. What is presented therefore is a…

In this paper, we propose a conceptual framework to guide the design of a computer-supported collaborative learning intervention to help students learn how to improve collaborative knowledge building discourse at the level of the small group. The framework focuses on scripting individual and collective regulatory processes following collaboration.…

Federal and state mandates for public education have a long history of changes that have occurred over the past thirty-four years since the publication of "A Nation at Risk" in 1983. Since then, educators have continued to raise student achievement levels to meet the growing demand to compete in a global society. Research has shown the…

The purpose of this study is to develop a valid and reliable measurement tool determining teachers' self-efficacy regarding rubrics. Especially in educational environments, rubrics are measurement tools used in the assessment phase of student products usually based on higher-order thinking skills. Determination of teachers' self-efficacy regarding…