This paper is aimed at demonstrating that Charles Spearman postulated neither a platonic true-error distinction nor a requirement for constant true scores under repeated measurement. (Author/RC)

Multiple choice questions that could logically provide two or more choices block the expression of judgment, thereby suppressing measurement of learning and failing to provide feedback to students and teachers. This study compares the effects of content identical multiple choice and multiple true false items on students' decision. (MT)

The correlation between bias components of test scores and unbiased observed scores is shown to be an effective predictor of changes in reliability and validity resulting from elimination of bias. Plausible assumptions about value of correlation and size of related variance components indicate that reducation in reliability and validity is a…

The models of standard test theory, having evolved under a trait-oriented psychology, do not reflect the knowledge structures and the problem-solving strategies now seen as central to understanding performance and learning. In some applications, however, key qualitative distinctions among persons as to structures and strategies can be expressed…

In educational assessment, what students say, do, and sometimes make is observed, and assessors attempt to infer what students know, can do, or have accomplished more generally. Some links in the chain of inference depend on statistical models and probability-based reasoning, and it is with these links that terms such as validity, reliability, and…

Psychologist Andrea diSessa coined the term "phenomenological primitives", or p-prims, to talk about nonexperts' reasoning about physical situations. P-prims are primitive in the sense that they stand without significant explanatory substructure or explanation. Examples are "Heavy objects fall faster than light objects" and "Continuing force is…

Methods for evaluating the consistency of responses to test items were compared. When a researcher is unwilling to make the assumptions of classical test theory, has only a small number of items, or is in a tailored testing context, Cliff's dominance indices may be useful. (Author/CTM)

It has often been asserted that the reliability of a measure places an upper limit on its validity. This article demonstrates in theory that validity can rise when reliability declines, even when validity evidence is a correlation with an acceptable criterion. Whether empirical examples can actually be found is an open question. (SLD)

Modified equations for the validity and reliability of difference scores that describe applied testing situations are examined. This examination reveals that simple gain scores can be more useful in research than has commonly been believed. Simple gain scores are neither inherently unreliable nor lack predictive validity. (SLD)

A study concluding that the Wechsler Adult Intelligence Scale (Revised) (WAIS-R) has three clear factors in its structure is critiqued. An alternative factor comparison technique, FACTOREP, is used with identical data. It is demonstrated that the WAIS-R has only two strong factors--verbal comprehension and perceptual organization. (TJH)

Within covariance structural analysis, a unified approach to asymptotic theory of alternative test criteria for testing parametric restrictions is provided. More general statistics for addressing the case where the discrepancy function is not asymptotically optimal, and issues concerning power analysis and the asymptotic theory of testing-related…

Provides a history of validation in language testing, discusses current approaches to validation in language testing (hypothesis about testing outcomes, relevant evidence for testing the hypothesis, developing a validity argument), and gives an overview of current challenges in language-test validation (defining the language construct to be…

Responses of 903 Canadian college students to the Self-Monitoring Scale (M. Snyder, 1974) and artificial data are used to illustrate the importance of pairing test theoretical structure with quantitative characteristics, including conditional association (CA) and strong positive orthant dependence (SPOD). Tests for CA and SPOD are reviewed. (SLD)

Presents an overview of linking methods applied to performance assessment and discusses major issues and recent developments in linking performance assessments. Compares three common linking designs and two major linking methodologies (classical and item response theory (IRT)). Describes two classical equating methods and several IRT equating…

Argues that the apparent lack of empirical support for the practice of profile analysis has stemmed in part from the use of statistical techniques that have neglected to explore the perspective of the clinician. Explores Configural Frequency Analysis, a statistical technique focusing on the relationships among groups of participants as the unit of…