The purpose of this study was to evaluate whether multiple-choice item difficulty could be predicted either by a subjective judgment by the question author or by applying a learning taxonomy to the items. Eight physiology faculty members teaching an upper-level undergraduate human physiology course consented to participate in the study. The…

Research on study-time allocation has largely focused on agenda-based regulation, such as whether learners select items for study that are in their region of proximal learning. In 4 experiments, the authors evaluated the contribution of habitual responding to study-time allocation (e.g., reading from left to right). In Experiments 1 and 2,…

Research in automated creation of test items for assessment purposes became increasingly important during the recent years. Due to automatic question creation it is possible to support personalized and self-directed learning activities by preparing appropriate and individualized test items quite easily with relatively little effort or even fully…

The purpose of this study is to develop a survey of technological pedagogical and content knowledge (TPACK). The survey consists of seven subscales forming the TPACK model: 1) technology knowledge (TK), 2) pedagogy knowledge (PK), 3) content knowledge (CK), 4) technological pedagogical knowledge (TPK), 5) technological content knowledge (TCK), 6)…

People with autism spectrum condition (ASC) perform well on Raven's matrices, a test which loads highly on the general factor in intelligence. However, the mechanisms supporting enhanced performance on the test are poorly understood. Evidence is accumulating that milder variants of the ASC phenotype are present in typically developing individuals,…

The psychometric properties of the Positive and Negative Affect Schedule were examined in a multiethnic sample of adolescents. Results from confirmatory factor analyses indicated that the original two-factor model did not adequately fit the data. Exploratory factor analyses revealed that four items were not pure markers of the factors. (Contains 1…

Current college admissions tests inadequately predict college success (Geiser & Studley, 2002) and provide insufficient information for students and teachers regarding college readiness at earlier stages of students' academic careers (Olson, 2006). This article reports on the creation and validation of a more informative test rooted in college…

Should an intelligent software tutor be polite, in an effort to motivate and cajole students to learn, or should it use more direct language? If it should be polite, under what conditions? In a series of studies in different contexts (e.g., lab versus classroom) with a variety of students (e.g., low prior knowledge versus high prior knowledge),…

This report examines the consequences of differential item functioning (DIF) using simulated data. Its impact on total score, item response theory (IRT) ability estimate, and test reliability was evaluated in various testing scenarios created by manipulating the following four factors: test length, percentage of DIF items per form, sample sizes of…

This simulation study compared the performance of two multilevel measurement testlet (MMMT) models: Beretvas and Walker's (2008) two-level MMMT model and Jiao, Wang, and Kamata's (2005) three-level model. Several conditions were manipulated (including testlet length, sample size, and the pattern of the testlet effects) to assess the impact on the…

This study is an evaluation of the behavior of the Liu-Agresti estimator of the cumulative common odds ratio when identifying differential item functioning (DIF) with polytomously scored test items using small samples. The Liu-Agresti estimator has been proposed by Penfield and Algina as a promising approach for the study of polytomous DIF but no…

Spatial ability tasks appear on many intelligence and aptitude tests. Although the construct validity of spatial ability tests has often been studied through traditional correlational methods, such as factor analysis, less is known about the cognitive processes involved in solving test items. This study examines the cognitive processes involved in…

The present work examined the discovery of linguistic cues during a word segmentation task. Whereas previous studies have focused on sensitivity to individual cues, this study addresses how individual cues may be used to discover additional, correlated cues. Twenty-four 9-month-old infants were familiarized with a speech stream in which…

This article reviews practice variation in the field of instructional design. First, it compares instructional designer practice as reported or observed in several classic research studies. This analysis is framed by the standards established by the International Board for Training, Performance, and Instruction competencies for planning and…

Overexposure and underexposure of items in the bank are serious problems in operational computerized adaptive testing (CAT) systems. These exposure problems might result in item compromise, or point at a waste of investments. The exposure control problem can be viewed as a test assembly problem with multiple objectives. Information in the test has…