The purpose of this study is to carry out differential item functioning (DIF) analysis for content areas of a reading comprehension subtest using four area indices within Item Response Theory (IRT) framework. The differences in the magnitudes of the area indices were compared based on the subject areas. The DIF analysis was carried out across…

The purpose of this research is to examine the comparability of mathematics and science scores for students from English language backgrounds (ELB) and non-English language backgrounds (NELB). We examine the relationship between English reading proficiency and performance on mathematics and science assessments in Australia, Canada, the United…

Minimum sample sizes of about 200 to 250 per group are often recommended for differential item functioning (DIF) analyses. However, there are times when sample sizes for one or both groups of interest are smaller than 200 due to practical constraints. This study attempts to examine the performance of Simultaneous Item Bias Test (SIBTEST),…

Growing interest in understanding the role of students' social-emotional competence for school success necessitates valid measures for large-scale use. We provide validity evidence for the 40-item Washoe County School District Social-Emotional Competency Assessment (WCSD-SECA), a student self-report measure that came from a researcher-practitioner…

Limited research has been accomplished within the past few years regarding issues and concerns of assessment for English Language Learners (ELL) with Learning Disabilities (LD). The increasing number of this unique population throughout schools has raised many concerns for professionals in education. English Language Learners with Learning…

Several sources of bias can plague research data and individual assessment. When cultural groups are considered, across or even within countries, it is essential that the constructs assessed and evaluated are as free as possible from any source of bias and specifically from bias caused due to culturally specific characteristics. Employing the…

Purpose: This policy brief discusses validity and fairness issues that could arise when test-based information is used for making "high stakes" decisions at an individual level, such as, for the certification of teachers or other professionals, or when admitting students into higher education programs and colleges, or for making…

Unlike intelligence, creativity has rarely been investigated from the standpoint of cross-cultural invariance of the structure of the instruments used to measure it. In the study reported in this article, we investigated the cross-cultural invariance of expert ratings of creative stories written by undergraduate students from the Russian…

The SAT is used for two purposes at the University of California. First is "eligibility": Determining whether applicants meet the minimum requirements for admission to the UC system. Second is "admissions selection": At high-demand campuses such as Berkeley, with many more eligible applicants than places available, test scores…

We analyzed a pool of items from an admissions test for differential item functioning (DIF) for groups based on age, socioeconomic status, citizenship, or English language status using Mantel-Haenszel and item response theory. DIF items were systematically examined to identify its possible sources by item type, content, and wording. DIF was…

Proficiency with written communication (WC) is critical for success in college and careers. As a result, institutions face a growing challenge to accurately evaluate their students' writing skills to obtain data that can support demands of accreditation, accountability, or curricular improvement. Many current standardized measures, however, lack…

The New Mexico Public Education Department developed the Kindergarten Observation Tool (KOT) as a multidimensional observational measure of students' knowledge and skills at kindergarten entry. The primary purpose of the KOT is to inform instruction, so that kindergarten teachers can use the information about their students' knowledge and skills…

Raju, van der Linden, and Fleer (1995) introduced a framework for differential functioning of items and tests (DFIT) for unidimensional dichotomous models. Since then, DFIT has been shown to be a quite versatile framework as it can handle polytomous as well as multidimensional models both at the item and test levels. However, DFIT is still limited…

Schools present a unique environment in which to conduct universal screenings for youth depression. The present study examines the efficiency of a multiple-stage assessment procedure assessing youth depression in the schools by calculating hit rates and establishing diagnostic accuracy for the measures used. Girls (N = 3318) aged 8 to 13,…

The present study examined measurement invariance across gender and gender differences on two measures of test anxiety developed for U.S. middle and high school, and college students. It was hypothesized that measurement invariance and gender differences would be found on the two measures of test anxiety, suggesting no separate scoring system is…