Several validated adult autism symptom screening tools exist; however, there are concerns about the validity of instruments in adults who self-identify and those who have an autism diagnosis. This study evaluated the psychometric properties of the RAADS-R and RAADS-14 across gender, autism diagnosis and autistic identity, and age among a sample of…

In many countries, standardized math tests are important for achieving academic success. Here, we examine whether content of items, the story that explains a mathematical question, biases performance of low-SES students. In a large-scale cohort study of Trends in International Mathematics and Science Studies (TIMSS)--including data from 58…

This study investigated potential item bias in a large-scale grade 3 reading achievement test, specifically against culturally diverse students with limited familiarity with mainstream Canadian culture. Students were classified based on their first language and length of residence in Canada, which was used as a proxy for cultural familiarity. A…

This article presents generalizations of SIBTEST and crossing-SIBTEST statistics for differential item functioning (DIF) investigations involving more than two groups. After reviewing the original two-group setup for these statistics, a set of multigroup generalizations that support contrast matrices for joint tests of DIF are presented. To…

Differential item functioning (DIF) occurs when the probability of endorsing an item differs across groups for individuals with the same latent trait level. The presence of DIF items may jeopardize the validity of an instrument; therefore, it is crucial to identify DIF items in routine operations of educational assessment. While DIF detection…

Recent efforts to opt out of assessments have focused attention on the role that testing plays in accountability reforms in the United States. While opt-out activists often invoke the disproportionate impact of these reforms on communities of color, opting out has been more widespread in mostly White, affluent, and suburban communities. This study…

This report summarizes an investigation of literature published in 1985-2023 on universal design (UD) of large-scale assessments. State education agencies, K-12 assessment vendors, teacher trainers, and classroom teachers are increasingly applying the principles of UD to the instruction and assessment of students from special populations. In…

This study addresses the underexplored terrain of conceptualizing and operationalizing race and ethnicity as grouping variables in Differential Item Functioning (DIF) studies within the context of psychometric research. The investigation extends beyond the identification of DIF and delves into the theoretical framing and communication of findings…

This study examined the calculation methods of P121 and P10 scores used in teacher appointments. The statistics regarding the Public Personnel Selection Examination (PPSE) subtests used by Measurement, Selection and Placement Center (MSPC) in 2018, 2019 and 2020 were accessed from the website of the institution. The parameters not published on…

When developing a test, it is essential to ensure that the test is free of items with differential item functioning (DIF). DIF occurs when examinees of equal ability, but from different examinee subgroups, have different chances of getting the item correct. According to the multidimensional perspective, DIF occurs because the test measures more…

Differential bundle functioning (DBF) has been proposed to quantify the accumulated amount of differential item functioning (DIF) in an item cluster/bundle (Douglas, Roussos, and Stout). The simultaneous item bias test (SIBTEST, Shealy and Stout) has been used to test for DBF (e.g., Walker, Zhang, and Surber). Research on DBF may have the…

Studies have confirmed that fair assessment practices in educational contexts affect learners' motivation, self-regulation, and above all teacher credibility, yet the concept has been subject to educational stakeholders' diverse outlooks and perspectives. On this basis, this study delves into the high school English as Foreign Language (EFL)…

The Grand Challenges Project supports global collaborations that inform equitable practices for assessment practitioners in higher education while identifying evidence-informed solutions. One goal named in the project is to leverage assessment findings to increase equity in higher education. This article focuses on the results from the Equity…

The operationalization of school climate is inconsistent, adding to an unwieldy existing body of climate instruments, bringing into question measurement validity concerns. Further, there is minimal literature regarding if comparisons can be made between different school sectors (i.e., public, private, charter). We seek to understand if a commonly…

Preknowledge cheating jeopardizes the validity of inferences based on test results. Many methods have been developed to detect preknowledge cheating by jointly analyzing item responses and response times. Gaze fixations, an essential eye-tracker measure, can be utilized to help detect aberrant testing behavior with improved accuracy beyond using…