This research explored the absolute accuracy of judgments of learning (JOLs), wherein absolute accuracy pertains to how well the magnitude of the participant's predictions of recall correspond to his or her subsequent recall. The Anchoring Hypothesis proposes that the magnitude of JOLs does not change systematically with item difficulty; analogous…

Mathematical literacy is an important skill that is gaining the attention of mathematics educators. Students are increasingly challenged on standardized assessments to read, create, use, and comprehend numerous mathematical representations as a way of demonstrating mathematical literacy. Test items assessing algebra concepts from the Texas…

The use of "neutral or unsure" on an instrument designed to measure identity development in college students was explored. The nominal response model from item response theory was used to evaluate whether "neutral or unsure" was used more frequently by those at low or middle levels of development; the results depended on the subscale and sometimes…

The purpose of this article is to present a working definition of the term "culture," as well as to describe and demonstrate a comprehensive framework for evaluating hypotheses about cultural bias in educational testing. The framework is demonstrated using 5th-grade reading and language arts data from the Terra Nova test (CTB/McGraw-Hill, 1999).…

Recent studies have shown that restricting review and answer change opportunities on computerized adaptive tests (CATs) to items within successive blocks reduces time spent in review, satisfies most examinees' desires for review, and controls against distortion in proficiency estimates resulting from intentional incorrect answering of items prior…

In today's higher education, high quality assessments play an important role. Little is known, however, about the degree to which assessments are correctly aimed at the students' levels of competence in relation to the defined learning goals. This article reviews previous research into teachers' and students' perceptions of item difficulty. It…

The Motor-Free Visual Perception Test: Third edition (MVPT-3; Colarusso & Hammill, 2003) purports to measure overall visual perceptual ability. Task responses require no motor ability, eliminating the effect of motor performance on the overall visual perception score. The test authors suggested that this MVPT-3 characteristic allows for its…

Technical characteristics of the Reading Essential Skill Screener--Preschool Version (RESS-P) were studied using four independent samples of boys and girls aged 3-5 years. A decision efficiency study (N = 91) resulted in a total predictive value (TPV) of .85 when compared with the criterion of teacher report/judgment of emerging literacy at-risk…

In this article, the authors describe the refinement and preliminary evaluation of the Dimensions of Change in Therapeutic Community Treatment Instrument (DCI), a measure of treatment process. In Study 1, a 99-item DCI, administered to a cross-sectional sample of substance abuse clients (N = 990), was shortened to 54 items on the basis of results…

This article uses the work of two students to illustrate the need to consider changing the format of test items or making language adjustments to increase the validity of the test items as measures of the mathematics that students know.

The present studies were undertaken to examine the effects of manipulating delay-interval task (Study 1) and timing of feedback (Study 2) on acquisition and retention. Participants completed a 100-item cumulative final examination, which included 50 items from each laboratory examination, plus 50 entirely new items. Acquisition and retention were…

Technical characteristics of the Reading Essential Skills Screener-Elementary Version (RESS-E; B. T. Erford, G. Vitali, R. Haas, & R. R. Boykin, 1995) were studied using 4 independent samples of boys and girls between the ages of 6 and 8 years. Evidence of internal consistency, test-retest reliability, decision efficiency, factorial validity,…

The Nation's Report Card[TM] informs the public about the academic achievement of elementary and secondary students in the United States and its jurisdictions, including Puerto Rico. In 2003, a trial NAEP mathematics assessment was administered in Spanish to public school students at grades 4 and 8 in Puerto Rico. Based on preliminary analyses of…

This paper presents the assessment and item specifications for the National Assessment of Educational Progress (NAEP) 2009 mathematics assessment. "Chapter Two" contains descriptions of the five major content areas of mathematics (Number Properties and Operations, Measurement, Geometry, Data Analysis, Statistics, and Probability, and…

This report describes the results of two studies designed to evaluate the impact of self-reported mathematics course-taking on performance on SAT mathematics questions measuring new content (Algebra II). A supplemental table and figure are appended.