The increasing numbers of English language learners (ELLs) in Canadian schools pose a significant challenge to the standards-based provincial tests used to measure proficiency levels of all students from various linguistic and cultural backgrounds. This study investigated the extent to which reading item bundles or items on the Ontario Secondary…

The purpose of the present study is to examine the language characteristics of a few states' large-scale assessments of mathematics and science and investigate whether the language demands of the items are associated with the degree of differential item functioning (DIF) for English language learner (ELL) students. A total of 542 items from 11…

This article explores the reasoning employed by high school students to answer a set of multiple-choice history questions. The questions come from New York State's Global History and Geography Regents exam. The Regents exams, together with a particularly well-regarded and ambitious set of content standards, are the cornerstone of the state's…

To determine the extent to which knowledge of evidence-based reading instruction and mathematics is assessed on licensure tests for prospective special education teachers, this study drew on information provided by Educational Testing Service (ETS), the American Board for Certification of Teacher Excellence, and National Evaluation Systems (now…

The author used Rasch measurement to examine the reliability and validity of 382 Korean university students' scores on the Marlowe-Crowne Social Desirability Scale (MCSDS; D. P. Crowne and D. Marlowe, 1960). Results revealed that item-fit statistics and principal component analysis with standardized residuals provide evidence of MCSDS'…

This article considers personnel selection from a counseling perspective by investigating applicants' and recruiters' perceptions of the selection procedure. A survey was conducted among 700 applicants and 140 recruiters to investigate whether applicants' and recruiters' preferences for and expectations of the selection procedure were similar or…

The nature of persisting spreading activation from list presentation in eliciting false recognition in the Deese-Roediger-McDermott (DRM) paradigm was examined in two experiments. We compared the time course of semantic priming in the lexical decision task (LDT) and false alarms in speeded recognition under identical study and test conditions. The…

This report describes the development, administration, and scoring of open-ended variants of GRE® Subject Test items in biology and psychology. These questions were administered in a Web-based experiment to registered examinees of the respective Subject Tests. The questions required a short answer of 1-3 sentences, and responses were automatically…

Differential item functioning (DIF) analysis can be used to great advantage in second language (L2) assessments. This study examined the differences in performance on L2 test items between groups from different first language backgrounds and suggested ways of improving L2 assessments. The study examined DIF on L2 (Hebrew) test items for two…

We have designed, developed, and validated a 25-question Genetics Concept Assessment (GCA) to test achievement of nine broad learning goals in majors and nonmajors undergraduate genetics courses. Written in everyday language with minimal jargon, the GCA is intended for use as a pre- and posttest to measure student learning gains. The assessment…

The purpose of this study is to apply the attribute hierarchy method (AHM) to a sample of SAT algebra items administered in March 2005. The AHM is a psychometric method for classifying examinees' test item responses into a set of structured attribute patterns associated with different components from a cognitive model of task performance. An…

We report the development of the Assessment of Individual Motives-Questionnaire (AIM-Q), a new instrument based on an evolutionary psychology theory of human motivation. It provides multitrait-multimethod (MTMM) assessment of individual differences on 15 motive scales. A total heterogeneous sample of N = 1,251 participated in eight studies that…

Growing recognition of the central importance of fostering an in-depth understanding of natural selection has, surprisingly, failed to stimulate work on the development and rigorous evaluation of instruments that measure knowledge of it. We used three different methodological tools, the Conceptual Inventory of Natural Selection (CINS), a modified…

Programs supported by the Carl D. Perkins Act of 2006 are required to operate under the state or national content standards, and are expected to carry out evaluation procedures that address accountability. The Indiana high school course, "Advanced Life Science: Foods" ("ALS: Foods") operates under the auspices of the Perkins…

The purpose of this paper was to describe the process of development of assessment instruments for the Comparing Options in Secondary Mathematics: Investigating Curriculum (COSMIC) project. The COSMIC project was a three-year longitudinal comparative study focusing on evaluating high school students' mathematics learning from two distinct…