Many methods exist for imputing missing data but fewer methods have been proposed to test the missing data mechanism. Little (1988) introduced a multivariate chi-square test for the missing completely at random data mechanism (MCAR) that compares observed means for each pattern with expectation-maximization (EM) estimated means. As an alternative,…

This issue of ETS Policy Notes (Vol 21, No. 2) highlights the discussion from "Taking Action: Navigating the Common Core State Standards and Assessments," a conference co-convened by ETS and the National Urban League (NUL) in February 2013. Part of the Saturdays at ETS series, the conference brought together researchers, funders,…

Plotting data from a second observer have been suggested as an alternative to presenting only mean agreement and ranges across sessions. One argument against this method of reporting is that plotting these data would not change analysis decisions by persons analyzing graphs. To empirically test this argument, we asked graduate students to analyze…

Changes to the design and development of our educational assessments are resulting in the unprecedented demand for a large and continuous supply of content-specific test items. One way to address this growing demand is with automatic item generation (AIG). AIG is the process of using item models to generate test items with the aid of computer…

An algorithm has been developed for the rapid determination of single-gene inheritance patterns from genetic pedigrees.

Two recent lines of research suggest that explicitly naming objects at study influences subsequent memory for those objects at test. Lupyan (2008) suggested that naming "impairs" memory by a representational shift of stored representations of named objects toward the prototype (labeling effect). MacLeod, Gopie, Hourihan, Neary, and Ozubko (2010)…

Assessment results collected under low-stakes testing situations are subject to effects of low examinee effort. The use of computer-based testing allows researchers to develop new ways of measuring examinee effort, particularly using response times. At the item level, responses can be classified as exhibiting either rapid-guessing behavior or…

In validating uses of testing, it is helpful to distinguish those that rely directly on the information provided by scores or score distributions ("direct" uses and consequences) versus those that instead capitalize on the motivational effects of testing, or use testing and test reporting to shape public opinion ("indirect" uses and consequences).…

The purposes of this study are twofold. First, to investigate the construct or factorial structure of a set of Reading and Mathematics computerized adaptive tests (CAT), "Measures of Academic Progress" (MAP), given in different states at different grades and academic terms. The second purpose is to investigate the invariance of test…

We discuss the limitations of hypothesis testing using (quasi-) experiments in the study of cognitive development and suggest latent variable modeling as a viable alternative to experimentation. Latent variable models allow testing a theory as a whole, incorporating individual differences with respect to developmental processes or abilities in the…

The Talent Search model, founded at Johns Hopkins University by Dr. Julian C. Stanley, is fundamentally an above-level testing program. This simplistic description belies the enduring impact that the Talent Search model has had on the lives of hundreds of thousands of gifted students as well as their parents and teachers. In this article, we…

In the human sciences, a common assumption is that latent traits have a hierarchical structure. Higher order item response theory models have been developed to account for this hierarchy. In this study, computerized adaptive testing (CAT) algorithms based on these kinds of models were implemented, and their performance under a variety of…

Traditional methods for item selection in computerized adaptive testing only focus on item information without taking into consideration the time required to answer an item. As a result, some examinees may receive a set of items that take a very long time to finish, and information is not accrued as efficiently as possible. The authors propose two…

This article systematically examines differences between student and faculty perspectives on quality instruction, using local data for a regional university's college of business matched to RateMyProfessors.com evaluations. Particular attention is focused on gender bias, "hotness," and "easiness." In addition to documenting a…

Prismatic refraction is a classic topic in science education. To investigate how undergraduate students think about prismatic dispersion, and to see how they change their thinking when observing dispersed images, five teaching experiments were done and analysed according to the Model of Educational Reconstruction. For projection through a prism,…