Many of us have an intuitive understanding of physics that works surprisingly well to guide everyday action, but we would not attempt to send a rocket to the moon with it. Unfortunately, the authors argue, our policy makers are not as cautious when it comes to basing our school accountability system on intuitive test theory. Intuitive physics…

A line-bisecting test was administered to 250 highly skilled right-handed athletes and a control group of 60 right-handed age matched non-athletes. Results revealed that athletes made overwhelmingly more rightward errors than non-athletes, who predominantly bisected lines to the left of the veridical center. These findings were interpreted in the…

This study explored select psychometric properties of the Everyday Discrimination Scale in 120 Black adolescents (65 males and 55 females). Youth completed the Everyday Discrimination Scale and the Child Behaviour Checklist-Youth Self-Report Form. A t-test analysis revealed that Everyday Discrimination Scale scores were not significantly different…

This paper presents the assessment and item specifications for the National Assessment of Educational Progress (NAEP) 2009 mathematics assessment. "Chapter Two" contains descriptions of the five major content areas of mathematics (Number Properties and Operations, Measurement, Geometry, Data Analysis, Statistics, and Probability, and…

Two competing structural models for the revised Learning and Study Strategies Inventory (LASSI) were examined. The test developers promote a model related to three uncorrelated components of strategic learning: skill, will, and self-regulation. Other investigators have shown empirical support for a three-factor correlated model characterized by…

Relationships between Bayesian ability estimates and the parameters of a normal population distribution are derived in the context of classical test theory. Analogies are provided for use as approximations in work with item response theory (IRT). The following issues are addressed: (1) the relationship between the distribution of the latent…

A person's obtained score on a test provides an estimate of the individual's "true" score on that test. The obtained score is considered to have two parts, the true component and the error component. Classical test theory assumes that obtained scores for an individual over multiple administrations of the same test will lie symmetrically…

The purpose of this investigation was to develop a general framework for qualitatively analyzing the 1992 National Assessment of Educational Progress (NAEP) extended constructed-response questions. The framework dimensions were based on information about the NAEP extended questions and linked to important ideas in mathematics education and…

Some applications of Bayesian decision theory to intelligent tutoring systems are considered. How the problem of adapting the appropriate amount of instruction to the changing nature of a student's capabilities during the learning process can be situated in the general framework of Bayesian decision theory is discussed in the context of the…

This study examined four measures of creativity as predictors of mathematics and science performance in a program for talented high school students (N=29). Correlational analyses indicated that the How Do You Think Test (HDYT) and ratings on the Teachers' Evaluation of Students' Creativity (TESC) were predictive of the students' performance in the…

Large-scale educational assessments differ from familiar educational measurements by attempting to provide information about the levels and natures of skills in populations rather than in individuals. That the distinct purposes of assessment require different methodologies than individual measurement was recognized by the development of…

The aim of this paper is to explore the Rasch model as a criterion of test homogeneity. Two empirical studies are presented to demonstrate this usage. From these studies it is argued that statistical tests of item characteristic curve (ICC) slopes are not sufficient in testing for heterogeneity. Tests of equality of ICC's over groups of subject…

This paper points out that there are certain generalizations about directions for guessing and methods of scoring that require that data be derived from random groups design. It supports the viewpoint that it is neither sufficient nor appropriate to make such generalizations on the basis of an analysis of scores obtained from the answer sheets of…

New ability estimators have been proposed by Wainer and Wright (1980) and Mislevy and Bock (1981) that are resistant against guessing and careless behaviors exhibited by some examinees. This paper presents another class of ability estimators that are resistant to departures from the underlying assumptions concerning guessing and carelessness. In…

Several extended caution indices (ECIs) have been introduced earlier as a link between two distinctly different approaches: one based on standard statistics and the other, a model-based approach, utilizing item response theory (IRT). Expected values and variance of some ECIs are derived and their statistical properties are compared and discussed.…