A person's obtained score on a test provides an estimate of the individual's "true" score on that test. The obtained score is considered to have two parts, the true component and the error component. Classical test theory assumes that obtained scores for an individual over multiple administrations of the same test will lie symmetrically…

The purpose of this investigation was to develop a general framework for qualitatively analyzing the 1992 National Assessment of Educational Progress (NAEP) extended constructed-response questions. The framework dimensions were based on information about the NAEP extended questions and linked to important ideas in mathematics education and…

Some applications of Bayesian decision theory to intelligent tutoring systems are considered. How the problem of adapting the appropriate amount of instruction to the changing nature of a student's capabilities during the learning process can be situated in the general framework of Bayesian decision theory is discussed in the context of the…

This study examined four measures of creativity as predictors of mathematics and science performance in a program for talented high school students (N=29). Correlational analyses indicated that the How Do You Think Test (HDYT) and ratings on the Teachers' Evaluation of Students' Creativity (TESC) were predictive of the students' performance in the…

Large-scale educational assessments differ from familiar educational measurements by attempting to provide information about the levels and natures of skills in populations rather than in individuals. That the distinct purposes of assessment require different methodologies than individual measurement was recognized by the development of…

The aim of this paper is to explore the Rasch model as a criterion of test homogeneity. Two empirical studies are presented to demonstrate this usage. From these studies it is argued that statistical tests of item characteristic curve (ICC) slopes are not sufficient in testing for heterogeneity. Tests of equality of ICC's over groups of subject…

This paper points out that there are certain generalizations about directions for guessing and methods of scoring that require that data be derived from random groups design. It supports the viewpoint that it is neither sufficient nor appropriate to make such generalizations on the basis of an analysis of scores obtained from the answer sheets of…

New ability estimators have been proposed by Wainer and Wright (1980) and Mislevy and Bock (1981) that are resistant against guessing and careless behaviors exhibited by some examinees. This paper presents another class of ability estimators that are resistant to departures from the underlying assumptions concerning guessing and carelessness. In…

Several extended caution indices (ECIs) have been introduced earlier as a link between two distinctly different approaches: one based on standard statistics and the other, a model-based approach, utilizing item response theory (IRT). Expected values and variance of some ECIs are derived and their statistical properties are compared and discussed.…

Score equating requires that the forms to be equated are functionally parallel. That is, the two test forms should rank order examinees in a similar fashion. In language proficiency testing situations, this assumption is often put into doubt because of the numerous tests that have been proposed as measures of language proficiency and the…

The purpose of this study was to determine how cognitive style instructions to respondents of a survey instrument affected the resulting psychometric properties of the scale. It was hypothesized that a group which is instructed to carefully respond will have a mean score further from the neutral point, a larger standard deviation, and a higher…

The career of Stuart Appleton Courtis in the growth of testing and educational measurement parallels the development of progressive education in the first half of the twentieth century. In 1909 he developed the standardized Courtis Arithmetic Test, Series A, the first objective test used in any city public schools. Continuing his work in testing,…

Assuming that the density p of the true ability theta in the binomial test score model is continuous in the closed interval (0, 1), a Bernstein polynomial can be used to uniformly approximate p. Then via quadratic programming techniques, least-square estimates may be obtained for the coefficients defining the polynomial. The approximation, in turn…

The reliabilities of various observational measures were determined, and the influence of both the number and the length of the observation periods on reliability was examined, both separately and jointly. A single simplifying assumption leads to a variant of the Spearman-Brown formula, which may have wider application. (Author/CTM)

Issues concerning equating test scores are discussed in an introduction, four papers, and two commentaries. Equating methods research, sampling errors, linear equating, population differences, sources of equating errors, and a circular equating paradigm are considered. (SLD)