Does participation in one wave of a survey have an effect on respondents' answers to questions in subsequent waves? In this article, we investigate the presence and magnitude of "panel conditioning" effects in one of the most frequently used data sets in the social sciences: the General Social Survey (GSS). Using longitudinal records…

Within polytomous items, differential item functioning (DIF) can take on various forms due to the number of response categories. The lack of invariance at this level is referred to as differential step functioning (DSF). The most common DSF methods in the literature are the adjacent category log odds ratio (AC-LOR) estimator and cumulative…

The Autism Spectrum Quotient is a widely used instrument for the detection of autistic traits. However, the validity of comparisons of Autism Spectrum Quotient scores between groups may be threatened by differential item functioning. Differential item functioning entails a bias in items, where participants with equal values of the latent trait…

The conceptual foundation and initial psychometric evidence are provided for the "Instructional Coaching Rating Scales" and "Interaction Style Scales--Teacher Forms." These forms are part of a multicomponent online assessment system designed to evaluate the effectiveness of coaching skills and interactions that support the…

SIBTEST is a differential item functioning (DIF) detection method that is accurate and effective with small samples, in the presence of group mean differences, and for assessment of both uniform and nonuniform DIF. The presence of multilevel data with DIF detection has received increased attention. Ignoring such structure can inflate Type I error.…

The purpose of this ITEMS module is to provide an introduction to differential item functioning (DIF) analysis using mixture item response models. The mixture item response models for DIF analysis involve comparing item profiles across latent groups, instead of manifest groups. First, an overview of DIF analysis based on latent groups, called…

Racial/ethnic bias in the prediction of students' educational potential was questioned in the Larry P. Vs. Riles case. The construct and predictive validity of the Woodcock-Johnson IV Tests of Cognitive Abilities (WJ IV; Schrank et al. 2014b) have not been examined for racial/ethnic bias. This study extended Keith's (1999) examination of bias…

As a method to shorten the test time of the Force Concept Inventory (FCI), we suggest the use of computerized adaptive testing (CAT). CAT is the process of administering a test on a computer, with items (i.e., questions) selected based upon the responses of the examinee to prior items. In so doing, the test length can be significantly shortened.…

Although recent research has reported equity gains in the university-level physics classroom, there remains evidence of significant inequities by race. We conducted a series of multiple linear regressions to examine the magnitude of these inequities in introductory mechanics final exam scores. When we followed a common method of grouping students…

This article presents a critical review of the Texas English Language Proficiency Assessment System (TELPAS), a large scale standardized English language proficiency (ELP) assessment developed by the Texas Education Agency (TEA) and administered since 2004. TELPAS is used as an annual summative assessment for all English Learners (ELs) in grades…

This report provides 10 lessons about how to ensure inclusive assessment practices for students with disabilities and English learners. In addition to the 10 lessons, it provides foundational information on the characteristics of these students that require consideration during all phases of assessment design, development, and implementation. The…

The lack of sensitive measures suitable for use across the range of functioning in autism spectrum disorder (ASD) is a barrier to treatment development and monitoring. The Emotion Dysregulation Inventory (EDI) is a caregiver-report questionnaire designed to capture emotional distress and problems with emotion regulation in both minimally verbal…

Even though guessing biases difficulty estimates as a function of item difficulty in the dichotomous Rasch model, assessment programs with tests which include multiple-choice items often construct scales using this model. Research has shown that when all items are multiple-choice, this bias can largely be eliminated. However, many assessments have…

In this article, we investigate the Visual Arts Educative Teacher Performance Assessment (edTPA) while integrating aspects of philosopher Jean-François Lyotard's thought in order to bring to light implicit assumptions made by the test. We expose disconnections between a mission for art education to create teachers as inquirers and the type of…

The main purpose of this article is to present a Differential Item Functioning method of item analysis. It is designed to minimize the discriminatory effect of individual items in the accreditation of graduates of medical universities with different training programs. The one-parameter Item Response Theory model is used to align graduates' rights…