The purpose of the study was to examine gender differences in performance on multiple-choice mathematical ability test, administered within the context of high school graduation test that was designed to match eleventh grade curriculum. The transformed item difficulty (TID) was used to detect a gender related DIF. A random sample of 1400 eleventh…

In this article we compare students' understanding of vector concepts in problems with no physical context, and with three mechanics contexts: force, velocity, and work. Based on our "Test of Understanding of Vectors," a multiple-choice test presented elsewhere, we designed two isomorphic shorter versions of 12 items each: a test with no…

The author describes the steps taken by a research team, of which she was part, to develop a specific methodology for assessing student attainment in primary school, working with the Programme for the Analysis of Education Systems (PASEC) of the Conference of Ministers of Education of French-speaking Countries (CONFEMEN). This methodology provides…

Background: We compared responsiveness to two self-report assessments of loneliness: the "UCLA Loneliness Scale" (UCLALS) designed for the general community, and the "Modified Worker Loneliness Questionnaire" (MWLQ) designed for people with intellectual disability (ID). Methods: Participants were 56 older adults with…

This booklet grew out of a half-day class on equating that author Samuel Livingston teaches for new statistical staff at Educational Testing Service (ETS). The class is a nonmathematical introduction to the topic, emphasizing conceptual understanding and practical applications. The class consists of illustrated lectures, interspersed with…

Large-scale numeracy assessments are intended to facilitate the improvement of educational outcomes; however, it is not clear exactly how this is to be achieved. To move towards the goal of numeracy for all, it is necessary to systematically address issues that are known to be difficult, pervasive and persistent. This paper includes an analysis of…

Learning standards across the United States have increasingly called for history students to engage in aspects of "historical thinking," a term used to describe the complex disciplinary processes that historians use to make sense of the past. Although students are expected to learn these complex processes, little is known about how to…

Population invariance in equating exists when the relationship between two scales is the same for two or more subpopulations of examinees and hence the function used to equate the scales is not dependent on subpopulations. A lack of equating invariance (i.e., equating dependence) leads to a situation whereby examinees having the same score on one…

Among cues that fail to elicit successful recall, participants can still discriminate between cues that do and do not resemble studied items. This ability is referred to as recognition without cued recall (RWCR). We hypothesized that whereas recognition with cued recall is at least partly based on recalled studied information, RWCR results from a…

In recent studies, different methods were proposed to investigate invariant item ordering (IIO), but practical IIO research is an unexploited field in questionnaire construction and evaluation. In the present study, the authors explored the usefulness of different IIO methods to analyze personality scales and clinical scales. From the authors'…

For mixed-type tests composed of both dichotomous and polytomous items, polytomous items often yield more information than dichotomous ones. To reflect the difference between the two types of items, polytomous items are usually pre-assigned with larger weights. We propose an item-weighted likelihood method to better assess examinees' ability…

The probability of test takers changing answers upon review of their initial choices is modeled. The primary purpose of the model is to check erasures on answer sheets recorded by an optical scanner for numbers and patterns that may be indicative of irregular behavior, such as teachers or school administrators changing answer sheets after their…

These guidelines describe considerations relevant to the assessment of test takers in or across countries or regions that are linguistically or culturally diverse. The guidelines were developed by a committee of experts to help inform test developers, psychometricians, test users, and test administrators about fairness issues in support of the…

Students' explanations of biological phenomena are frequently characterized by disconnects between levels and confusion of levels. The purpose of this research is to investigate the effects of a hands-on lab activity that aims at fostering the ability to reason across levels. A total of 197 students (18 years of age) participated in a randomized,…

Problem Statement: Algebra, which is one of the basic principles of mathematical learning, still maintains its importance in mathematics programmes. However, especially starting from the primary school years, algebra represents a complex mathematical factor in the operational stage for many students. In this scope, a differentiated teaching…