This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Childhood social and emotional competencies are recognized as teachable skills affecting well-being and developmental outcomes across the life span. This study sought to develop and validate a brief self-report measure of social-emotional competencies in middle childhood. The study used items from the 2015 Middle Childhood Survey, administered to…

Assessing students' conceptions related to independence of events and determining probabilities from a sample space has been the focus of research in probability education for over 40 years. While we know a lot from past studies about predictable ways students may reason with well-known tasks, developing a diagnostic assessment that can be used by…

Background: Early childhood intervention (ECI) centres in Spain recently initiated a process of change towards the adoption of family-centred practices (FCPs). Knowledge about the extent to which practitioners' use FCPs is needed. The psychometric properties of the Spanish version of the FCPs scale were examined. Method: A convenience sample of…

An empirical evidence for independent samples of a population regarding measurement invariance implies that factor structure of a measurement tool is equal across these samples; in other words, it measures the intended psychological trait within the same structure. In this case, the evidence of construct validity would be strengthened within the…

This paper investigates reasoned risk-taking in decision-making by school principals using a methodology that combines sequential use of psychometric and traditional measurement techniques. Risk-taking is defined as when decisions are made that are not compliant with the regulatory framework, the primary governance mechanism for public schools in…

The purpose of this study was to develop and test a scale assessing students' moral thinking and communication (MTC) functioning as well as to explore the implications for moral development and education. The rationale of MTC functioning, including interaction of four independent competencies: moral awareness, moral judgement, moral discourse, and…

When conducting item reviews, analysts evaluate an array of statistical and graphical information to assess the fit of a field test (FT) item to an item response theory model. The process can be tedious, particularly when the number of human reviews (HR) to be completed is large. Furthermore, such a process leads to decisions that are susceptible…

The law of comparative judgment is described, and applications in the measurement of psychological values are reviewed. The law defines the psychological continuum and expresses the experimentally observed proportion of judgments as a function of scale values of stimuli, their respective discriminal dispersions, and the correlation between paired…

Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

This study describes the use of generalizability theory (GT) and many-facet Rasch measurement (MFRM) to evaluate psychometric properties of responses obtained from an assessment designed to measure complex problem-solving skills. The assessment revolved around the school activity of kickball. The task required of each student was to decide on a…

This paper describes two procedures for making binary classification decisions using tailored testing: the sequential probability ratio test (SPRT) and a Bayesian decision procedure. The first procedure described, the SPRT, was developed by Wald for quality control work. It has not been widely applied for testing applications because the…

The Presidential Address at the 1986 National Council on Measurement in Education Annual Meeting argues that measurement specialists have tended to set unrealistic aspirations for the role tests play. The conjunctive decision making model is discussed and the use of data in the conjunctive and compensatory decision making models is examined. (JAZ)

This reply to William A. Mehrens argues that test validity is the central issue in discussing the appropriate role of tests. It states that the procedures used to establish the validity of tests are inadequate because they depend primarily on content validity and not on construct and criterion validity. (JAZ)