Test-takers can be required to complete a test form, but cannot be forced to demonstrate their knowledge. Even if an authority mandates completion of a test, examinees can still opt to enter responses randomly. When a test has important consequences for individuals, examinees are unlikely to behave this way. However, random responding becomes more…

The study of measurement invariance in polytomous items that targets individual score levels is known as differential step functioning (DSF; Penfield, 2007, 2008). DSF methods provide specific information describing the manifestation of the invariance effect within particular score levels and therefore serve a diagnostic role in identifying the…

Many theoretical models of reading assume that different writing systems require different processing assumptions. For example, it is often claimed that print-to-sound mappings in Chinese are not represented or processed sub-lexically. We present a connectionist model that learns the print-to-sound mappings of Chinese characters using the same…

Many physical science and physics instructors might not be trained in pedagogically appropriate test construction methods. This could lead to test items that do not measure what they are intended to measure. A subgroup of these items might show bias against some groups of students. This paper describes how the author became aware of potentially…

The electrophysiological correlates of retrieval orientation--the differential processing of retrieval cues according to the nature of the sought-for information--were investigated in healthy young (18-20 years old) and older (63-77 years old) adults. In one pair of study-test cycles, subjects studied either words or pictures presented in one of…

Jeopardy!, the trivia game show, is approaching its 25th year on television. With its amazingly bright contestants, daily doubles, potpourri categories, double jeopardy rounds, tick-tock music played during final jeopardy, and tournament of champions, Jeopardy! has become a media icon in American popular culture. Unfortunately, Jeopardy! isn't…

Recent changes to federal guidelines for the collection of data on race and ethnicity allow respondents to select multiple race categories. Redefining race subgroups in this manner poses problems for research spanning both sets of definitions. NAEP long-term trends have used the single-race subgroup definitions for over thirty years. Little is…

The aim of this paper is to present a shortened version of the SIS (support intensity scale) obtained by the application of mathematical models and instruments, adopting special algorithms based on the most recent developments in artificial adaptive systems. All the variables of SIS applied to 1,052 subjects with ID (intellectual disabilities)…

This report is structured so as to provide technical detail about each aspect of International Civic and Citizenship Education Study (ICCS). The overview is followed by a series of chapters that provide detail about different aspects of ICCS. Chapters, 2, 3, 4, and 5 are concerned with the instruments. Chapter 2 provides information about the…

As the largest international study ever taken in history, the Trend in Mathematics and Science Study (TIMSS) has been held as a benchmark to measure U.S. student performance in the global context. In-depth analyses of the TIMSS project are conducted in this study to examine key issues of the comparative investigation: (1) item flaws in mathematics…

The challenge inherent in cross-national research of providing instruments in different languages measuring the same construct is well known. But even instruments in a single language may be biased towards certain countries or regions due to local linguistic specificities. Consequently, it may be appropriate to use different versions of an…

Letter-name identification has been widely used as part of early screening to identify children who might be at risk for future word reading difficulty. The goal of the present study was to examine whether a reduced set of letters could have similar diagnostic accuracy rather than a full set (i.e., 26 letters) when used as a screen. First, we…

In this study, the perceptions of parents (n = 14) and students (n = 47) enrolled in a blended learning course, the first of its kind at their school, were examined. Student performance in the blended and in the traditional portion of the course was examined, and the Educational Success Prediction Instrument (ESPRI) was administered to predict…

Test security has been a concern for computerized adaptive tests (CAT) due to the nature of continuous testing. This concern becomes unprecedentedly severe with increasingly easy access to the World-Wide-Web where some examinees post on the internet their recollections of items they are administered, leaving future examinees with opportunities to…

Reliability is a property of test scores from individuals who have been sampled from a well-defined population. Reliability indices, such as coefficient and related formulas for internal consistency reliability (KR-20, Hoyt's reliability), yield lower bound reliability estimates when (a) subjects have been sampled from a single population and when…