The multitrait-multimethod (MTMM) paradigm is used widely to assess construct validity, but D. A. Kenny and D. A. Kashy (1992) lament that even after 30 years we still do not know how to analyze MTMM data. The Composite Direct Product (CDP) model has recently attracted considerable attention. Its strengths and weaknesses are evaluated, and a…

A study examined the varying degrees to which learners of Spanish at the intermediate and advanced levels use paragraph-like structure in their answers during a simulated oral proficiency exam. Subjects were 24 students preparing for the Spanish Texas Oral Proficiency Test. Data from simulated oral proficiency interviews were compared to a model…

This study investigated and compared the properties of five methods of item exposure control within the purview of estimating examinees' abilities in a computerized adaptive testing (CAT) context. Each of the exposure control algorithms was incorporated into the item selection procedure and the adaptive testing progressed based on the CAT design…

A simulation experiment demonstrated that the perceptual sensitivity of Swedish and Danish students at upper secondary school level varies systematically concerning the basic conditions for "personal growth." An attempt is made to constrain this concept contextually, in such a way that it can be described behaviorally. It is made evident…

A simple scheme is proposed for smoothly approximating the ability distribution for relatively long tests, assuming that the item characteristic curves (ICCs) are known or well estimated. The scheme works for a general class of ICCs and is guaranteed to completely recover the theta distribution as the test length increases. The proposed method of…

Student modeling--the task of building dynamic models of student ability--is fraught with uncertainty, caused by such factors as multiple sources of student errors, careless errors and lucky guesses, learning and forgetting. Within the context of the Sherlock intelligent tutoring systems project, we have been experimenting with various ways of…

The functioning of two population-based Mantel-Haenszel (MH) common-odds ratios was compared. One ratio is conditioned on the observed test score, while the other is conditioned on a latent trait or true ability score. When the comparison group distributions are incongruent or nonoverlapping to some degree, the observed score represents different…

This study presents an overview of Monte Carlo studies in discriminant analysis. Some common questions about the use of Monte Carlo techniques are answered through a brief literature review of articles on discriminant analysis in which Monte Carlo methods are used. The articles cover many research points, such as comparing error rate estimates,…

The difference between compensatory and non-compensatory item response theory (IRT) models in terms of the dimensionality of test data generated by them, and its effect on the model-data-fit were examined. The STRESS (proportion of variance not accounted for by the multidimensional scaling model) and RSQ (proportion of variance accounted for by…

Perceptual-motor and cognitive processes whereby people perform multiple concurrent tasks have been studied through an overlapping-tasks procedure in which two successive choice-reaction tasks are performed with a variable interval (stimulus onset asynchrony, or SOA) between the beginning of the first and second tasks. The increase in subjects'…

A new index for assessing the dimensionality underlying a set of test items was investigated. The incremental fit index (IFI) is based on the sum of squares of the residual covariances. Purposes of the study were to: (1) examine the distribution of the IFI in the null situation, with truly unidimensional data; (2) examine the rejection rate of the…

Three methods of factor analyzing dichotomously scored item performance data were compared using two raw score data sets of 20-item tests, one reflecting normally distributed latent traits and the other reflecting uniformly distributed latent traits. This comparison was accomplished by using phi and tetrachoric correlations among dichotomous data…

Predictors of novice learning in simulation environments were investigated in the domain of statistics. The first objective was to clarify the relation between intellectual ability and working method (e.g., orientation and systematical orderliness), and to determine the effects on learning of working method, independently of intellectual ability.…

Multiple group factor analysis is described and illustrated through a simulation involving 5,000 examinees. The estimation process of the group factors were implemented using the TESTFACT program of Wilson and others (1987). Group factor analysis is described as a special case of confirmatory factor analysis. Group factors can be computed based on…

Metacognitive skills may be defined in a variety of ways. Generally, these ways all apply to people's thinking about their own personal thinking. This research study analyzed students' interactions to computer programs to assess their metacognitive skills. The metacognitive skills assessed were: (1) planning a course of action; (2) monitoring the…