Process Analysis is an emerging approach to discover meaningful knowledge from temporal educational data. The study presented in this paper shows how we used Process Analysis methods on the National Assessment of Educational Progress (NAEP) test data for modeling and predicting student test-taking behavior. Our process-oriented data exploration…

In high-stakes, large-scale, standardized tests with certain time limits, examinees are likely to engage in either one of the three types of behavior (e.g., van der Linden & Guo, 2008; Wang & Xu, 2015): solution behavior, rapid guessing behavior, and cheating behavior. Oftentimes examinees do not always solve all items due to various…

Two versions of a general method for approximating standard error of regression effect estimates within an IRT-based latent regression model are compared. The general method is based on Binder's (1983) approach, accounting for complex samples and finite populations by Taylor series linearization. In contrast, the current National Assessment of…

National Assessment of Educational Progress (NAEP) Mathematics Assessment (1982) data were analyzed using latent class models to determine patterns of distinct skills required by different exercises and to estimate the pattern distributions. The populations were 9-, 13-, and 17-year-old examinees. Skills were assumed to be intermediate between…

National Assessment of Educational Progress reading data were scaled using a unidimensional item response theory model. Bock's full-information factor analysis and Rosenbaum's test of unidimensionality were applied. Conclusions about unidimensionality for balanced incomplete block spiralled data were the same as for complete data. (Author/GDC)

The purpose of this research study was to assess item response model-test data fit using residuals. First, a comparison of raw and standardized residuals for describing model-test data fit was carried out. Second, hypotheses concerning the relationship between residual sizes and several item characteristics were studied. The analyses with…

Procedural documentation is presented for administering, scoring and analyzing data gathered to examine the construct validity of a set of superitems developed to assess student levels of mathematical reasoning ability. Each superitem includes a mathematical situation and a structured set of questions about that situation. The questions were based…

Reading test data from the National Assessment of Educational Progress (NAEP) were scaled using the unidimensional item response theory model. Data were collected for students aged 9, 13, and 17. To determine whether the responses to the reading items were consistent with unidimensionality, four different methods were applied: (1) principal…

More than a dozen statistical models have been developed for the purpose of cognitive diagnosis. These models are supposed to extract a much finer level of information from item responses than traditional unidimensional item response models. In this paper, a general diagnostic model (GDM) was used to analyze a set of simulated sparse data and real…

The 63 items on skills in acquiring and using information from written documents contained in the Survey of Young Adult Literacy in the 1985 National Assessment of Educational Progress are analyzed. The analyses are based on a qualitative cognitive model and an item-response theory model. (TJH)