The concept of error detection plays a central role in theories of executive control. In this article, the authors present a mechanism that can rapidly detect errors in speeded response time tasks. This error monitor assigns values to the output of cognitive processes involved in stimulus categorization and response generation and detects errors…

Educational and psychological testing textbooks typically warn of the inappropriateness of performing arithmetic operations and statistical analysis on percentiles instead of raw scores. This seems inconsistent with the well-established finding that transforming scores to ranks and using nonparametric methods often improves the validity and power…

The main purpose of this study is to examine the content structure of the Multistate Bar Examination (MBE) using the "table of specifications" model from the perspective of multivariate generalizability theory. Specifically, using MBE data collected over different years (six administrations: three from the February test and three from July test),…

Item bias is a major threat to measurement validity. Methods for detecting differential item functioning (DIF) are now commonly used to identify potentially biased items. DIF detection methods for dichotomous items are well developed, but those for ordinal items are less well developed. In this article, the authors compare four methods for…

A new report published by the Buckeye Institute for Public Policy Solutions is a minor variant on six similar reports published by the Friedman Foundation over the past three years. The new report repeats some of the errors in the previous reports, and it follows a parallel structure, arguing that the costs of dropping out are dramatic for the…

This paper reports the findings of an experiment that investigated the reactions of Saudi college students to collaborative learning techniques introduced in two modalities: face-to-face and web-based learning. Quantitative data were collected with a questionnaire that examined the changes of three constructs: attitudes toward collaboration,…

A simple, guided-inquiry investigation using stacked sandwich cookies is employed to develop a simple linear mathematical model and to explore measurement error by incorporating errors as part of the investigation. Both random and systematic errors are presented. The model and errors are then investigated further by engaging with an interactive…

The persistent gap between the performance of mainstream students and racially and linguistically diverse students--for example, African Americans, Hispanic Americans, and Native Americans--on standardized tests may well signal problems with procedures for the development and use of standardized tests in general, and for their use with culturally…

Background: The appropriateness of the "Diagnostic and Statistical Manual of Mental Disorders-Fourth Edition" (DSM-IV) nosology for classifying preschool mental health disturbances continues to be debated. To inform this debate, we investigate whether preschool psychopathology shows differentiation along diagnostically specific lines…

The basic theory of Rasch measurement applies to situations where a person has a certain level of a trait being investigated, and this level of ability is what determines (to within a measurement error) how well the person does on each item in a test. This paper responds to frequent suggestions from colleagues that the use of Rasch measurement…

Extensive evidence exists demonstrating the utility of Curriculum-Based Measurement in reading (R-CBM) for progress-monitoring purposes; however, most studies have evaluated R-CBM from a traditional psychometric perspective, which allows for variability in individual student's data that is not a function of increased skills (i.e., measurement…

This article proposes and tests a formal cognitive model for the go/no-go discrimination task. In this task, the performer chooses whether to respond to stimuli and receives rewards for responding to certain stimuli and punishments for responding to others. Three cognitive models were evaluated on the basis of data from a longitudinal study…

Large scale surveys usually employ a complex sampling design and as a consequence, no standard methods for estimation of the standard errors associated with the estimates of population means are available. Resampling methods, such as jackknife or bootstrap, are often used, with reference to their properties of robustness and reduction of bias. A…

A Monte Carlo study was used to examine the Type I error rates of five multivariate tests for the single-factor repeated measures model. The performance of Hotelling's T-squared and four nonparametric tests, including a chi-square and an "F" test version of a rank-transform procedure, was investigated for different distributions, sample…

A person's obtained score on a test provides an estimate of the individual's "true" score on that test. The obtained score is considered to have two parts, the true component and the error component. Classical test theory assumes that obtained scores for an individual over multiple administrations of the same test will lie symmetrically…