This article investigates the transition to memory-based performance that commonly occurs with practice on tasks that initially require use of a multistep algorithm. In an alphabet arithmetic task, item response times exhibited pronounced step-function decreases after moderate practice that were uniquely predicted by T. C. Rickard's (1997)…

Newtonian mechanics is a core module in technology courses, but is difficult for many students to learn. Computerized tutoring can assist the teachers to provide individualized instruction. This article presents the application of decision theory to develop a tutoring system, "iTutor", to select optimal tutoring actions under uncertainty of…

In this study we investigated the effects of the average signed area (ASA) between the item characteristic curves of the reference and focal groups and three test purification procedures on the uniform differential item functioning (DIF) detection via the Mantel-Haenszel (M-H) method through Monte Carlo simulations. The results showed that ASA,…

Differential item functioning (DIF) analyses are a routine part of the development of large-scale assessments. Less common are studies to understand the potential sources of DIF. The goals of this study were (a) to identify gender DIF in a large-scale science assessment and (b) to look for trends in the DIF and non-DIF items due to content,…

There are two main theories with respect to the development of spelling ability: the stage model and the model of overlapping waves. In this paper exploratory model based clustering will be used to analyze the responses of more than 3500 pupils to subsets of 245 items. To evaluate the two theories, the resulting clusters will be ordered along a…

In this article we describe the development, analysis, and interpretation of a novel item format we call Ordered Multiple-Choice (OMC). A unique feature of OMC items is that they are linked to a model of student cognitive development for the construct being measured. Each of the possible answer choices in an OMC item is linked to developmental…

This essay discusses the author's encounter with PRAXIS II test preparation questions that distort and misrepresent complex reading processes. Three sample test items are presented and discussed.

Students (N=153) in three equivalent sections of an undergraduate human development course compared pairs of related concepts via either written or oral discussion at the beginning of most class sessions. A writing-for-random-credit section achieved significantly higher ratings on the writing activities than did a writing-for-no-credit section.…

The purpose of this document is to provide background information that will be useful in interpreting the 2007 results from the Trends in International Mathematics and Science Study (TIMSS) by comparing its design, features, framework, and items with those of the U.S. National Assessment of Educational Progress and another international assessment…

Behavioral Research and Teaching (BRT) has developed a series of mathematics tests to assist local school districts in identifying students in grades 1-8 who may be at risk of not meeting year-end mathematics achievement goals. The tests were developed using the state mathematics standards for the relevant grade levels and administered to students…

This study is a comparison of 2 versions of an Internet-based tutorial that teaches the behavior-analysis concept of positive reinforcement. A fixed-item group of students studied a version of the tutorial that included 14 interactive examples and nonexamples of the concept. A response-sensitive group of students studied a different version of the…

Guiding deaf and hard of hearing students in making important decisions about their adult careers can be a difficult task. Twenty years after its inception, the TCB, as adapted for deaf and hard of hearing students, may help. The TCB is a unique assessment tool designed to measure the transition skills of deaf high school adolescents and young…

This article describes the development and validation of the Light and Spectroscopy Concept Inventory (LSCI), a 26-item diagnostic test designed (1) to measure students' conceptual understanding of topics related to light and spectroscopy, and (2) to evaluate the effectiveness of instructional interventions in promoting meaningful learning gains…

In an examination of the effects of timing of feedback on student learning, participants were randomly assigned to complete five introductory course tests using either control (Scantron form) or one of three feedback (end-of-test, 24-hr delay, immediate) procedures. A cumulative final examination with 50 new items and 10 items repeated from each…

In this paper, the authors complete the summative stage of the validity argument approach, then use their experiences to reflect on the validity argument as a method. They begin by evaluating the inferences and assumptions of the interpretive argument for the MKT measures. Then they examine both the form and the structure of the interpretive…