Studies the effect of item order on test scores and completion time. Students scored slightly higher when test items were grouped sequentially (relating to text and lectures) than on tests when test items were grouped by text chapter but ordered randomly, or when test items were ordered randomly. Found no differences in completion time. (Author/LS)

This article identifies language issues confounding the assessment of deaf students' English writing competence. Possible alternate methods of test administration are explored, and direction for future test development is offered. (Author/DB)

The impact of capitalizing on chance in item selection on the accuracy of test information functions was studied through simulation, focusing on examinee sample size in item calibration and the ratio of item bank size to test length. (SLD)

Determining the optimal number of choices on a multiple-choice test is explored analytically from an information theory perspective. The analysis revealed that, in general, three choices seem optimal. This finding is in agreement with previous statistical and psychometric research. (SLD)

Data from the California Learning Assessment System mathematics assessment were used to examine issues that arise when scores from different assessment modes are combined. Multiple-choice, open-ended, and investigation items were combined in a test across three test forms. Results illustrate the difficulties faced in evaluating combined…

A newly developed performance standard-setting procedure, termed iterative judgmental policy capturing (JPC), is applicable to assessments composed of distinct multidimensional exercises. The procedure is described, and results are reported from the application of JPC in a study involving a panel of 20 teachers and 6 performance exercises. (SLD)

Currently there are at least four pretreatment-posttreatment (pre-post) difference score methods for determining client change. A fifth model, based on a random effects model and multiwave data, represents a growth curve approach and was hypothesized to be more sensitive to detecting significant (p<.05) change than pre-post models. Compares…

Argues that teachers need to become "informed consumers" of standardized tests in order to influence decisions about test use and about ways to help students perform at their best. Six strategies for considering the content of a test form are presented. (LR)

Beginning discussions and exploratory work on criterion-referenced measurement are reviewed in this commentary on the author's 1963 address to the American Educational Research Association on issues of measurement and the development of educational technology. Many problems foreseen at that time remain current. (SLD)

The term "criterion-referenced measurement" has been so frequently used that accumulated surplus meaning has sometimes swamped the fundamental concept. Stripping away extraneous interpretations affirms the contemporary relevance of the concept. Substituting the term "construct-referenced" underscores the need for better…

Results from 627 examinees taking a health sciences certification examination suggest that test items written purposefully to assess higher order cognitive skills do not provide evidence of assessing different levels of cognitive processing. Results do not support continuing use of a hierarchical cognitive classification dimension for the test…

A general linear latent trait model for continuous item responses is described. The special unidimensional case for continuous item response is the model of K. G. Joreskog (1971) of congeneric item response. The correspondence between models for continuous and dichotomous item responses is shown to be closer than usually supposed. (SLD)

Basic principles that should be followed by anyone developing a scale are reviewed, with emphasis on verbally mediated measures. The essential first step is a clear conceptualization of the target construct. Item development and ensuring unidimensionality follow. Factor analysis can be crucial in establishing unidimensionality and discriminant…

The Attitudes toward Inclusive Education Scale (ATIES) is a measure of positive and negative attitudes toward integrating children with disabilities into regular classes. Results with 445 teachers show that the ATIES defines a unidimensional attitudinal variable and yields interval measures of attitudes toward inclusive education. (SLD)

The criterion-related validity evidence and other psychometric characteristics of multiple-choice and multiple true-false (MTF) items in medical specialty certification examinations were compared using results from 21,346 candidates. Advantages of MTF items and implications for test construction are discussed. (SLD)