A key obstacle to measurement is the aggregation problem. Where indicators tap into common latent traits in theoretically meaningful ways, the problem may be solved by applying a data-informed ("inductive") measurement model, for example, factor analysis, structural equation models, or item response theory. Where they do not, researchers…

Many students view PISA as a low-stakes assessment. Their lack of willingness to give the assessment "their all" is reflected in students' performance. Boys are often disengaged, resulting in low test performance. Disengagement should be measured in various different ways to better understand it and improve assessment design.

This paper aims to extend understanding of the business and societal impact of academic research. From a business school perspective, it has taken stock of the role of academic research and relevance in business and society. The proposed conceptual framework highlights the forces influencing the pursuit of academic rigour and relevance in…

Contrary to popular belief, modern cognitive assessments--including the new Common Core tests--produce test scores based on sophisticated statistical models rather than the simple percent of items a student answers correctly. While there are good reasons for this, it means that reported test scores depend on many decisions made by test designers,…

This article argues that test takers are as integral to determining validity of test scores as defining target content and conditioning inferences on test use. A principled sustained attention to how students interact with assessment opportunities is essential, as is a principled sustained evaluation of evidence confirming the validity or calling…

In this article the authors argue that distinguishing between rationality and intelligence helps explain how people can be, at the same time, intelligent and irrational (Stanovich, 2009). As such, researchers need to study separately the individual differences in cognitive skills that underlie intelligence and the individual differences in…

The OECD is planning to enhance existing PISA assessment instruments in reading, mathematics and science so that they will be more suitable to the context of developing countries. The main purpose of this paper is to identify the main technical issues associated with this aim. The paper reports detailed analysis of the existing PISA item pool and…

In this paper, we describe the design, development, and initial validity evidence for the Screening to Assign Accommodations Tool (SAAT). The purpose of the SAAT is to identify students for whom construct irrelevant variance (CIV) might obscure measurement of their knowledge, skills, and abilities in mathematics. Once students are identified as…

Assessing student performance is a central challenge for music educators. In alignment with previous research, this article asserts that rubrics provide a viable and useful structure for assessing music performance. To expand the potential of rubrics in music education, challenges to effective rubric construction are identified and addressed…

The educational environment has been increasingly acknowledged as vital for high-quality medical education. As a result, several instruments have been developed to measure medical educational environment quality. However, there appears to be no consensus about which concepts should be measured. The absence of a theoretical framework may explain…

Decades of research in survey methodology and psychology have yielded important insights about how to create effective and valid survey instruments. As Porter (in press) has argued convincingly, college student surveys often fall well short of these standards by placing unrealistic demands on students' memory and by assuming that students readily…

We provide a critical review of existing teacher responsibility measures, develop the rationale for, and introduce a new Teacher Responsibility Scale (TRS). Evidence from a sample of German pre-service teachers (Study 1) and American in-service teachers (Study 2) supported a multi-dimensional model of teacher responsibility with four subscales…

The impetus for this paper stems from a concern about directions and progress in the measurement of the Technological Pedagogical Content Knowledge (TPACK) framework for effective technology integration. In this paper, we develop the rationale for using a seven-criterion lens, based upon contemporary validity theory, for critiquing empirical…

My point of departure in this essay is that student approaches to assessment appear to have become more instrumental, and that there has been a correlative propensity in my teaching practice to "teach to the test". Hence, both learners and teachers seem to have become more strategic in relation to assessment. This situation, I argue, is…

In this paper I explore how Margaret Beier, Lesley Miller, and Shu Wang make claims for the validity and reliability of the instrument they developed to explore the construct of "possible selves" as described in their manuscript, "Science Games and the Development of Scientific Possible Selves."