Models of creative problem solving are predicated upon mental states to explain everything from the outcome of problem-solving experiments to the emergence of artistic creativity. We present two converging perspectives that describe a profoundly different ontological description of creativity. Our analysis proceeds from a distinction between…

In this rejoinder, the authors describe the aim of the original study as an effort to conduct a critical test of an important postulate underlying the Cross-Battery Assessment PSW approach (XBA PSW; Kranzler, Floyd, Benson, Zaboski, & Thibodaux, this issue). The authors used classification agreement analysis to examine the concordance between…

When cut scores for classifications occur on the total score scale, popular methods for estimating classification accuracy (CA) and classification consistency (CC) require assumptions about a parametric form of the test scores or about a parametric response model, such as item response theory (IRT). This article develops an approach to estimate CA…

Crawford and Howell (1998) have pointed out that the common practice of z-score inference on cognitive disability is inappropriate if a patient's performance on a task is compared with relatively few typical control individuals. Appropriate univariate and multivariate statistical tests have been proposed for these studies, but these are only valid…

Compared to other subjects, the typical introductory programming (CS1) course has higher than usual rates of both failing and high grades, creating a characteristic bimodal grade distribution. In this article, I explore two possible explanations. The conventional explanation has been that learners naturally fall into populations of programmers and…

Imposed time limits on computer adaptive tests (CATs) can result in examinees having difficulty completing all items, thus compromising the validity and reliability of ability estimates. In this study, the effects of speededness were explored in a simulated CAT environment by varying examinee response patterns to end-of-test items. Expectedly,…

Perception is influenced by the perceiver's ability to perform intended actions. For example, when people intend to reach with a tool to targets that are just beyond arm's reach, the targets look closer than when they intend to reach without the tool (J. K. Witt, D. R. Proffitt, & W. Epstein, 2005). This is one of several examples demonstrating…

Assessments consisting of different domains (e.g., content areas, objectives) are typically multidimensional in nature but are commonly assumed to be unidimensional for estimation purposes. The different domains of these assessments are further treated as multi-unidimensional tests for the purpose of obtaining diagnostic information. However, when…

Recent research has found that the acquisition of theory of mind (ToM) is delayed in children with specific language impairment (SLI). The present study used a battery of ToM and visual perspective taking (VPT) tasks to investigate whether the delayed acquisition of ToM in children with SLI is associated with delayed VPT development. Harris'…

Compared student ability estimates with their true abilities under different rater scoring designs and differentially weighted composite scores through simulation. Results indicate that the spiraled rater scoring design without modeling rater effects works as well as the nested design in which rater tendencies are modeled. (SLD)

There has been increasing attention to the fine structure of abilities underlying task performance (E. H. Haertel and D. E. Wiley). One of the most useful approaches for this is by use of graphical models to represent relationships among abilities and test items. Building a large graphical model is always an issue. Restrictions upon experiments…

A modification of the SIBTEST procedure to assess differential item functioning (DIF) for two-dimensional test data (i.e., data for tests where two intended abilities are tapped by test items) is described. A small simulation study is carried out to assess the performance of the modified SIBTEST to detect DIF in such two-dimensional data. The…

A similarity-based smoothing approach to nondimensional item analysis was studied. Simulated and actual data are presented to show that when responses are determined by a latent ability variable, this similarity-based smoothing procedure can reveal the dimensionality of ability satisfactorily. (SLD)

Develops an item-parameter estimation procedure using an EM algorithm for the continuous-response model (F. Samejima, 1973). Examines the usefulness of this model using simulated data. Results show that the procedure performs well in estimating items and theta parameters. (SLD)

The interest in the application of large-scale adaptive testing for secure tests has served to focus attention on issues that arise when theoretical advances are made operational. Many such issues in the application of large-scale adaptive testing for secure tests have more to do with changes in testing conditions than with testing paradigms. One…