Orlando and Thissen (2000) developed an item fit statistic for binary item response theory (IRT) models known as S-X[superscript 2]. This article generalizes their statistic to polytomous unfolding models. Four alternative formulations of S-X[superscript 2] are developed for the generalized graded unfolding model (GGUM). The GGUM is a…

In 3 studies, the authors examined the prevalence and effects of a testing strategy whereby they gave a set of items to participants in advance and subsequently tested them on a portion of those items (i.e., subset testing). In a survey of university instructors, Study 1 showed that subset testing is a commonly used testing strategy. In this…

This article considers two methods of estimating standard errors of equipercentile equating: the parametric bootstrap method and the nonparametric bootstrap method. Using a simulation study, these two methods are compared under three sample sizes (300, 1,000, and 3,000), for two test content areas (the Iowa Tests of Basic Skills Maps and Diagrams…

To deter cheating, teachers commonly use exams printed on differently colored paper or with varied question orders. Previous studies, however, reported that paper color and question order affect exam performance and suggested that teachers should adjust students' scores accordingly and discontinue the use of alternate exam forms. We conducted 2…

"Harvard Education Letter" is published bimonthly at the Harvard Graduate School of Education. This issue of "Harvard Education Letter" contains the following articles: (1) Online Testing, Version 1.0: Oregon's Adaptive Computer-Based Accountability Test Offers a Peek at a Brave New Future (Robert Rothman); (2) Beyond…

The purpose of this study was to examine the alignment of the easyCBM[R] mathematics benchmark and progress monitoring measures to the National Council of Teachers of Mathematics "Curriculum Focal Points" (NCTM, 2006). Based on Webb's alignment model (1997, 2002), we collected expert judgments on individual math items across a sampling of forms…

This study inquires into whether prospective English language teachers consider the central exam, KPSS (The Selection Examination for Professional Posts in Public Organizations) valid to select and recruit English language teachers, and what suggestions they have concerning the improvement of the exam. The findings indicate that the majority of…

This article presents a review of the "Process Assessment of the Learner-Second Edition" (PAL-II), an individual or group-administered instrument designed to assess the cognitive processes involved in academic tasks in kindergarten through sixth grade. The instrument allows the examiner to identify reasons for underachievement and…

The study investigated the criterion-related validity of the "Test of English as a Foreign Language"[TM] Internet-based test (TOEFL[R] iBT) Listening section by examining its relationship to a criterion measure designed to reflect language-use tasks that university students encounter in everyday academic life: listening to academic…

Mathematical word problems represent a common item format for assessing student competencies. Automatic item generation (AIG) is an effective way of constructing many items with predictable difficulties, based on a set of predefined task parameters. The current study presents a framework for the automatic generation of probability word problems…

Pupil monitoring systems support the teacher in tailoring teaching to the individual level of a student and in comparing the progress and results of teaching with national standards. The systems are based on the availability of an item bank calibrated using item response theory. The assessment of the students' progress and results can be further…

This study investigates the validity of a newly developed computerized cognitive assessment system (CCAS) that is equipped with rich multimedia to generate simulated testing situations and considers both test item difficulty and the test taker's ability. It is also hypothesized that better predictive validity of the CCAS in self-care of persons…

While some students have the opportunity to engage in the kinds of structured inquiry and real-world problem solving called for in the science education reform literature, many other students receive only a daily grind of note taking, end-of-chapter questions and sample test items from state assessments. The result is an engagement gap whereby…

The success of early intervention programs has in large part spurred increasing emphasis on identifying children with autism and Pervasive Developmental Disorder-Not Otherwise Specified (PDD-NOS) at the earliest possible ages. National and international professional groups have called for early screening and diagnosis, yet the technology to…

A new Spanish version of the Cognitive Test Anxiety Scale (CTAS) was created to be used explicitly with Argentinean university students. The scale was translated and verified through blind back translation and given to a large sample of students majoring in psychology or chemistry (N = 752). Exploratory Factor Analysis (N = 376) showed an internal…