Item response theory (IRT) is a statistical paradigm for developing educational tests and assessing students. IRT, however, currently lacks an established graphical method for examining model fit for the three-parameter logistic model, the most flexible and popular IRT model in educational testing. A method is presented here to do this. The graph,…

There is great potential in making assessment and learning complementary. In this study, we investigated the feasibility of developing a desktop virtual reality (VR) laboratory simulation on the topic of genetics, with integrated assessment using multiple choice questions based on item response theory (IRT) and feedback based on the cognitive…

Used three approaches to understand the effect of the number of variables in the model on model fit in structural equation modeling through computer simulation. Developed a simple formula for the theoretical value of the comparative fit index. (SLD)

The distinction between deterministic and statistical reasoning in the application of models to educational measurement is explicated. Issues addressed include the relationship between data and estimation equations, distinction between parameters and parameter estimates, and power of tests of fit of responses across the ability continuum. (TJH)

Major issues related to index-of-fit conjoint analysis were addressed in this simulation study. Goals were to develop goodness-of-fit criteria for conjoint analysis; develop tests to determine the significance of conjoint analysis results; and calculate the power of the test of the null hypothesis of random data distribution. (SLD)

The purpose of the present investigation is to examine the influence of sample size (N) and model complexity on a set of 23 goodness-of-fit (GOF) indices, including those typically used in confirmatory factor analysis. The focus was on two potential problems in assessing GOF: (1) some fit indices are substantially influenced by N so that tests of…

A diabetes-management model is presented, which includes an attitudinal element and depicts relationships among causal elements. LISREL-VI was used to analyze data from 115 Type-I and 105 Type-II patients. The data did not closely fit the model. Results support the importance of the personal meaning of diabetes. (TJH)

This study investigated the distributional properties of the standardized residual that is commonly used in the Rasch model calibration program to develop various indices of item and person fit. The power of the standardized residual to detect measurement disturbances is also addressed. (TJH)

When repeated observations are taken at equal time intervals, a simple form of a stationary time series structure may be fitted to the observations. Use of correction factors is discussed. A computer simulation method is used to investigate power advantages of fitting a serial correlation pattern to repeated observations. (TJH)

This study examined how four commonly used test equating procedures (linear, equipercentile, Rasch Model, and three-parameter) would respond to situations in which the properties or the two tests being equated were different. Data for two tests plus an external anchor test were generated from a three parameter model in which mean test differences…

Standard maximum likeliheed estimation was compared using two forms of robust estimation, BIWEIGHT (based on Tukey's Biweight) and AMTJACK (AMT-Robustified Jackknife), and Rasch model person analysis. The two procedures recovered the generating parameters, but Rasch person analysis also helped to identify the nature of a response disturbance. (GDC)

The purpose of this paper is to present two new alternative methods to the current goodness of fit methodology. With the increase use of computerized adaptive test (CAT), the ability to determine the accuracy of calibrated item parameter estimates is paramount. The first method applies a normalizing transformation to the logistic residuals to make…

Discussion of how we perceive meaning from graphics highlights a computer simulation model, UCIE (Understanding Cognitive Information Engineering), that simulates graphical perception. An empirical study is described that compared actual performance to UCIE predictions related to the amount of time required to answer a question in various…

The purpose of this study was to use realistically simulated data to evaluate various CAT designs for use with the verbal reasoning measure of the Medical College Admissions Test (MCAT). Factors such as item pool depth, content constraints, and item formats often cause repeated adaptive administrations of an item at ability levels that are not…