We consider the problem of bias arising from conditioning on a post-outcome collider. We illustrate this with reference to Elwert and Winship (2014) but we go beyond their study to investigate the extent to which inverse probability weighting might offer solutions. We use linear models to derive expressions for the bias arising in different kinds…

Statistical process control (SPC) charts have been widely used in the field of educational measurement. The cumulative sum (CUSUM) is an established SPC method to detect aberrant responses for educational assessments. There are many studies that investigated the performance of CUSUM in different test settings. This paper describes the CUSUM…

The EdSurvey package helps users download, explore variables in, extract data from, and run analyses on large-scale assessment data. The analysis functions in EdSurvey account for the use of plausible values for test scores, survey sampling weights, and their associated variance estimator. We describe the capabilities of the package in the context…

An adapted grading system for students with disabilities in general physical education allows utilization of existing assessment tools such as rubrics and checklists and provides methods of individualization and modification based on the student's needs. Adapted grading methods include weighting components of class grades and unit assessments,…

The goal of this article is to introduce the revised Conceptual Understanding Weighting System (CUWS) Greene & Shorter (2012, Trans. Dial.), a tool for categorizing and weighting a mathematical task in order to identify the level of conceptual understanding being assessed by the task. In addition, there is discussion of how this weighting…

World university rankings use the weight-and-sum approach to process data. Although this seems to pass the common sense test, it has statistical problems. In recent years, seven such problems have been uncovered: spurious precision, weight discrepancies, assumed mutual compensation, indictor redundancy, inter-system discrepancy, negligence of…

This practice-sharing piece outlines two main approaches to flexible summative assessment schemes, including for each approach one example from my practice and another from a published study. The bento approach offers the same assessments to all students but a variety of grade weighting schemes, allowing students to change weighting during the…

This document covers the data terms used in publications sourced from the National VET Provider Collection and their associated data tables. The primary purpose of this document is to assist users of the publication to understand the specific data terms used within them. Terms that appear in the publications and data items are listed in…

The IEA's International Civic and Citizenship Education Study (ICCS) investigates the ways in which young people are prepared to undertake their roles as citizens in a range of countries in the second decade of the 21st century. ICCS 2016 is the second cycle of a study initiated in 2009. This technical report follows the publication of several…

Teachers want to succeed, but they typically lack the conditions for success. Teachers generally work in isolation. They're on their own to adjust practice to better serve students. What guidance they get often is plagued by vague teaching standards, overly numerous and often trivial learning objectives, and testing systems that measure only some…

Student feedback, test-score growth calculations, and observations of practice appear to pick up different but complementary information that, combined, can provide a balanced and accurate picture of teacher performance, according to research recently released from the Bill & Melinda Gates Foundation. A composite measure on teacher effectiveness…

In this paper, multiple criteria optimization has been investigated. A new decision support system (DSS) has been developed for interactive solving of multiple criteria optimization problems (MOPs). The weighted-sum (WS) approach is implemented to solve the MOPs. The MOPs are solved by selecting different weight coefficient values for the criteria…

This article presents the authors' rejoinder to commentaries on linear equating and the NEAT design. The authors appreciate the insightful work of the commentary writers. Each has made a number of interesting points, many of which the authors had not considered at all. Before responding to some of those points, the authors reiterate what they see…

This paper illustrates that the psychometric properties of scores and scales that are used with mixed-format educational tests can impact the use and interpretation of the scores that are reported to examinees. Psychometric properties that include reliability and conditional standard errors of measurement are considered in this paper. The focus is…

In this note, we show that if the integral of a continuous function, h, vanishes over an interval [a, b], then so does the integral of w(x)h(x) over [a, c] for some c in (a, b), where w is a monotonic increasing (decreasing) function on [a, b] with w(a) is non-negative (non-positive).