Michael Kane writes in this article that he is in more or less complete agreement with Professor Koretz's characterization of the problem outlined in the paper published in this issue of "Measurement." Kane agrees that current testing practices are not adequate for test-based accountability (TBA) systems, but he writes that he is far…

Theories of relational concept acquisition (e.g., schema induction) based on structured intersection discovery predict that relational concepts with a probabilistic (i.e., family resemblance) structure ought to be extremely difficult to learn. We report four experiments testing this prediction by investigating conditions hypothesized to facilitate…

In educational testing, differential item functioning (DIF) statistics must be accurately estimated to ensure the appropriate items are flagged for inspection or removal. This study showed how using the Rasch model to estimate DIF may introduce considerable bias in the results when there are large group differences in ability (impact) and the data…

The invited colloquium on New Directions in Language Assessment held at the American Association for Applied Linguistics (AAAL) annual meeting in Portland, Oregon on March 22, 2014 brought together an international panel of scholars to together explore the possibilities and challenges of translanguaging and bi/multilingual approaches in…

Two practical activities are described, which aim to support critical thinking about statistics as they concern multiple outcomes testing. Formulae are presented in Microsoft Excel spreadsheets, which are used to calculate the inflation of error associated with the quantity of tests performed. This is followed by a decision-making exercise, where…

This study aims to investigate the effects of item exposure control methods on measurement precision and on test security under various item selection methods and item pool characteristics. In this study, the Randomesque (with item group sizes of 5 and 10), Sympson-Hetter, and Fade-Away methods were used as item exposure control methods. Moreover,…

This inquiry is an investigation of item response theory (IRT) proficiency estimators' accuracy under multistage testing (MST). We chose a two-stage MST design that includes four modules (one at Stage 1, three at Stage 2) and three difficulty paths (low, middle, high). We assembled various two-stage MST panels (i.e., forms) by manipulating two…

We analyzed 2010 US National Emergency Department Sample data and ran regression models to test the hypotheses that individuals with ASD are more likely to have non-traumatic dental condition (NTDC)-related emergency department (ED) visits and to incur greater costs for these visits than those without ASD. There were nearly 2.3 million…

Deciding whether to grant test accommodations for a student with disabilities is challenging and controversial. Current accommodations practice is seldom research based, and professionals charged with such decisions often reach different conclusions. The result can be either unnecessary accommodations that compromise test validity or the denial of…

How to measure quality of early childhood education and care is an evergreen topic of research and discussion in various disciplines. Here, we propose a contribution from developmental neuroscience and neuroendocrinology. In this secondary data analysis study, we tested the hypothesis that salivary cortisol can serve as a reliable objective…

Directions used in curriculum-based measurement of reading (CBM-R) currently ask students to "do your best reading." The purpose of this study was to examine whether varying these verbal directions would affect CBM-R performance and whether these alternative directions would influence the important relation between CBM-R performance and…

Background: Problematic alcohol use is characterized by disrupted associative processing of environmental clues, where problematic drinkers interpret ambiguous, alcohol-relevant clues in an alcohol-related way. The present study examined the strength of this interpretation bias in a large sample (N = 230) of light and problematic drinkers with and…

Every two years, institutions sponsoring credentialing programs in California are required to submit a detailed biennial report, which includes data on at least four key assessments showing 1) candidate competence and/or 2) program efficacy. This article reports the types of assessments used from 25 institutions that completed biennial reports for…

Gender schema theory (GST) posits that children approach opportunities perceived as gender appropriate, avoiding those deemed gender inappropriate, in turn affecting gender-differentiated career trajectories. To test the hypothesis that children's gender salience filters (GSF--tendency to attend to gender) moderate these processes, 62 preschool…

While it is frequently argued that assessment sits at the heart of the learning process, in practice assessment often remains narrowly focused on qualifications and reporting achievements, driven by institutional and societal aspirations and tensions such as accountability and economic well being. Yet, the need for assessment to account for the…