Even though there is an increasing interest in response styles, the field lacks a systematic investigation of the bias that response styles potentially cause. Therefore, a simulation was carried out to study this phenomenon with a focus on applied settings (reliability, validity, scale scores). The influence of acquiescence and extreme response…

Standard errors computed according to the operational practices of international large-scale assessment studies such as the Programme for International Student Assessment's (PISA) or the Trends in International Mathematics and Science Study (TIMSS) may be biased when cross-national differential item functioning (DIF) and item parameter drift are…

As perfectly summarised by Ida Lawrence, "Testing is growing by leaps and bounds across the world. There is a realization that a nation's well-being depends crucially on the educational achievement of its population. Valid tests are an essential tool to evaluate a nation's educational standing and to implement efficacious educational reforms.…

The use of internal assessment within GCSE qualifications has always aroused controversy, primarily because of concerns about the authorship of students' work. This has led to tighter controls and a reduction in its use over the last decade. The paper argues that the focus on the authentication of student work has neglected other aspects of…

Although language test-takers have been the focus of much theoretical and empirical work in recent years, this work has been mainly concerned with their attitudes to test preparation and test-taking strategies, giving insufficient attention to their views on broader socio-political and ethical issues. This article examines test-takers' perceptions…

This study reports an independent investigation of the psychometric properties of Desired Results Developmental Profile (DRDP), a teacher-rated measure of school readiness for preschool-aged children. In a sample of 2,031 low-income, 3- to 5-year-old children attending Head Start, we tested three measurement models: a higher order one-factor…

Disability-as-diagnosis, disability-as-identity, and disability-as-experience as pressing measurement issues in learning outcomes assessment are described in this paper. Disability represents a critically important latent variable in many learning outcomes assessment plans unless it is a formalized part of analytic plans. Noting the potential for…

Comparing group is one of the key uses of large-scale assessment results, which are used to gain insights to inform policy and practice and to examine the comparability of scores and score meaning. Such comparisons typically focus on examinees' final answers and responses to test questions, ignoring response process differences groups may engage…

Research on equity in data literacy for teaching has lagged yet is of critical importance to ensuring new teachers are prepared to serve diverse students. Our multiple case study conveyed four elementary teacher candidates' understandings of this construct and their reaction to instruction in this domain. Data collection included interviews, item…

The present study investigated the psychometric properties of the "Scales for Assessing Emotional Disturbance -- Third Edition: Rating Scale" (SAED-3 RS), which is designed for use in identifying students with emotional disturbance for special education services. The purposes of this study were to evaluate (a) the measurement invariance…

Educational assessment is an ever-present component of any formal learning environment that has critical consequences for students. Despite this relevance, there is a gap in knowledge regarding one of its foundations--namely, assessment "fairness." In particular, social class-based fairness of classroom assessment practices has been…

We introduce an approach for making a quantitative comparison of the item response curves (IRCs) of any two populations on a multiple-choice test instrument. In this study, we employ simulated and actual data. We apply our approach to a dataset of 12,187 participants on the 25-item Science Literacy Concept Inventory (SLCI), which includes ample…

In this study, it is aimed to investigate the impact of different missing data handling methods on the detection of Differential Item Functioning methods (Mantel Haenszel and Standardization methods based on Classical Test Theory and Likelihood Ratio Test method based on Item Response Theory). In this regard, on the data acquired from 1046…

Does participation in one wave of a survey have an effect on respondents' answers to questions in subsequent waves? In this article, we investigate the presence and magnitude of "panel conditioning" effects in one of the most frequently used data sets in the social sciences: the General Social Survey (GSS). Using longitudinal records…

Within polytomous items, differential item functioning (DIF) can take on various forms due to the number of response categories. The lack of invariance at this level is referred to as differential step functioning (DSF). The most common DSF methods in the literature are the adjacent category log odds ratio (AC-LOR) estimator and cumulative…