There can be many reasons why students fail to answer correctly to summative tests in advanced computer science courses: often the cause is a lack of prerequisites or misconceptions about topics presented in previous courses. One of the ITiCSE 2020 working groups investigated the possibility of designing assessments suitable for differentiating…

Data comparison problems are used in teaching and science education research that focuses on students' ability to compare datasets and their conceptual understanding of measurement uncertainties. However, the evaluation of students' decisions in these problems can pose a problem: e.g., students making a correct decision for the wrong reasons.…

Student surveys have gained prominence in recent years as a way to give students a voice in their learning process, and teacher self-reports have always been an effective instrument for revealing the planning, intentions, and expectations behind a given lesson. Though student and teacher surveys are widely used, extant research in education has…

Background/Context: The target of assessment validation is not an assessment but the use of an assessment for a purpose. Although the validation literature often provides examples of assessment purposes, comprehensive reviews of these purposes are rare. Additionally, assessment purposes posed for validation are generally described as discrete and…

Assessment is a complex function requiring an understanding of student learning, assessment principles, practices, and purposes of data to implement effective classroom assessment. The purpose of this study was to add to the growing base of knowledge about teachers' engagement with assessment data and their motivation for classroom assessment.…

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

The National Staff Development Council (NSDC), a private, nonprofit association, has outlined high standards for educator professional learning. One demonstration of NSDC's commitment to the goal of ensuring all schools support and use high standards for professional learning is the organization's investment in developing an instrument to assess…

In general, it is assumed that distinct true values will be found behind what is actually measured in surveys. By acquiring sufficient knowledge of measurement error, its extent and nature, we are supposed to be able to obtain adequate knowledge of underlying properties. It could be maintained, however, that this idea of a stable and…

The main purpose of this paper is to draw attention to some facts and ideas that perhaps can help to identify problems or fields for development and research within the evaluation of training. Topics for group discussion are preceded by material on some basic concepts of evaluation and educational measurement. The ratio scale, the interval scale,…

The effects of aggregation on the reliability of measures of academic performance were explored in two studies. In the first study, 30 elementary-age children were tested four times on the same forms of the Woodcock Reading Mastery Tests and the Ginn 720 Reading Passage measures. Group stability coefficients, within-subject reliability…