Classification consistency and accuracy are viewed as important indicators for evaluating the reliability and validity of classification results in cognitive diagnostic assessment (CDA). Pattern-level classification consistency and accuracy indices were introduced by Cui, Gierl, and Chang. However, the indices at the attribute level have not yet…

Computer-assisted personal interviewing (CAPI) offers many attractive benefits over paper-and-pencil interviewing. There is, however, mixed evidence on the impact of CAPI on interview "length," an important survey outcome in the context of length limits imposed by survey budgets and concerns over respondent burden. In this article,…

The case is presented of an 8-year-old boy who was referred for psycho-educational assessment because of difficulties with writing. The article provides an example of the way in which a case unfolds as further assessment data become available, and describes a number of challenging aspects of the assessment process. In this case, dilemmas arose…

Infants have shown variable success in quantity comparison tasks, with infants of a given age sometimes successfully discriminating numerical differences at a 2:3 ratio but requiring 1:2 and even 1:4 ratios of change at other times. The current explanations for these variable results include the two-systems proposal--a theoretical framework that…

This study investigates the hypothesis that there is a natural number bias that influences how students understand the effects of arithmetical operations involving both Arabic numerals and numbers that are represented by symbols for missing numbers. It also investigates whether this bias correlates with other aspects of students' understanding of…

Michael Kane writes in this article that he is in more or less complete agreement with Professor Koretz's characterization of the problem outlined in the paper published in this issue of "Measurement." Kane agrees that current testing practices are not adequate for test-based accountability (TBA) systems, but he writes that he is far…

Theories of relational concept acquisition (e.g., schema induction) based on structured intersection discovery predict that relational concepts with a probabilistic (i.e., family resemblance) structure ought to be extremely difficult to learn. We report four experiments testing this prediction by investigating conditions hypothesized to facilitate…

In educational testing, differential item functioning (DIF) statistics must be accurately estimated to ensure the appropriate items are flagged for inspection or removal. This study showed how using the Rasch model to estimate DIF may introduce considerable bias in the results when there are large group differences in ability (impact) and the data…

The invited colloquium on New Directions in Language Assessment held at the American Association for Applied Linguistics (AAAL) annual meeting in Portland, Oregon on March 22, 2014 brought together an international panel of scholars to together explore the possibilities and challenges of translanguaging and bi/multilingual approaches in…

Two practical activities are described, which aim to support critical thinking about statistics as they concern multiple outcomes testing. Formulae are presented in Microsoft Excel spreadsheets, which are used to calculate the inflation of error associated with the quantity of tests performed. This is followed by a decision-making exercise, where…

This study aims to investigate the effects of item exposure control methods on measurement precision and on test security under various item selection methods and item pool characteristics. In this study, the Randomesque (with item group sizes of 5 and 10), Sympson-Hetter, and Fade-Away methods were used as item exposure control methods. Moreover,…

This inquiry is an investigation of item response theory (IRT) proficiency estimators' accuracy under multistage testing (MST). We chose a two-stage MST design that includes four modules (one at Stage 1, three at Stage 2) and three difficulty paths (low, middle, high). We assembled various two-stage MST panels (i.e., forms) by manipulating two…

We analyzed 2010 US National Emergency Department Sample data and ran regression models to test the hypotheses that individuals with ASD are more likely to have non-traumatic dental condition (NTDC)-related emergency department (ED) visits and to incur greater costs for these visits than those without ASD. There were nearly 2.3 million…

Deciding whether to grant test accommodations for a student with disabilities is challenging and controversial. Current accommodations practice is seldom research based, and professionals charged with such decisions often reach different conclusions. The result can be either unnecessary accommodations that compromise test validity or the denial of…

How to measure quality of early childhood education and care is an evergreen topic of research and discussion in various disciplines. Here, we propose a contribution from developmental neuroscience and neuroendocrinology. In this secondary data analysis study, we tested the hypothesis that salivary cortisol can serve as a reliable objective…