This study addresses the topic of how anchoring methods for differential item functioning (DIF) analysis can be used in multigroup scenarios. The direct approach would be to combine anchoring methods developed for two-group scenarios with multigroup DIF-detection methods. Alternatively, multiple tests could be carried out. The results of these…

Symptoms of inattention (IA), hyperactivity, and impulsivity present in school-aged children are important indications of developmental problems. The assessment of these symptoms largely relies on questionnaires completed by parents, teachers, and the children themselves. However, inherent perceptual biases may lead to inaccuracies in these…

Most assessments adopt a one-size-fits-all approach to provide fair testing opportunities to all learners. However, this rigid approach to assessment may limit the ability for some learners to show what they know and can do. The Caring Assessments framework proposed a guide for the design and development of flexible, personalized, and adaptive…

Survey instruments and assessments are frequently used in many domains of social science. When the constructs that these assessments try to measure become multifaceted, multidimensional item response theory (MIRT) provides a unified framework and convenient statistical tool for item analysis, calibration, and scoring. However, the computational…

Purpose: Several studies have demonstrated that dynamic assessment can be a less biased, valid approach for the identification of language disorder among diverse school-age children. However, all prior studies have included a relatively small number of participants, which is generally not adequate for psychometric research. This is the first…

Testing programs are confronted with the decision of whether to report individual scores for examinees that have engaged in rapid guessing (RG). As noted by the "Standards for Educational and Psychological Testing," this decision should be based on a documented criterion that determines score exclusion. To this end, a number of heuristic…

Despite the emergence of test-optional policies, standardized admission tests continue shaping the college composition and financial aid prospects of hundreds of thousands of students. This is concerning for the following reasons: (a) standardized test results have historically favored test-takers from wealthier and majority backgrounds, (b) test…

Practical constraints in rater-mediated assessments limit the availability of complete data. Instead, most scoring procedures include one or two ratings for each performance, with overlapping performances across raters or linking sets of multiple-choice items to facilitate model estimation. These incomplete scoring designs present challenges for…

The estimation of test score "gaps" and gap trends plays an important role in monitoring educational inequality. Researchers decompose gaps and gap changes into within- and between-school portions to generate evidence on the role schools play in shaping these inequalities. However, existing decomposition methods assume an equal-interval…

The indefinite nature of test fairness and different interpretations and definitions of the concept have stirred a lot of controversy over the years, necessitating the reconceptualization of the concept. On this basis, this study aimed to explore the empirical validity of Kunnan's (2008) Test Fairness Framework (TFF) and revisit the established…

Many schools now screen students for dyslexia in early grades. However, there are valid concerns that these screeners may be biased or ineffective at screening students who are not yet proficient in English (i.e., English Learners; ELs). The present study examined the performance of 54 first graders on a dyslexia screener. Results showed that…

An examination of gender-related differential item functioning was conducted on the verbal subtests of the Anadolu-Sak Intelligence Scale. Analyses were conducted using the scale standardization data (N = 4641). A Mantel-Haenszel statistic was used to detect differential item functioning (DIF). A total of 58 verbal analogical reasoning items, 20…

Aberrant behavior refers to any type of unusual behavior that would not be expected under normal circumstances. In educational and psychological testing, such behaviors have the potential to severely bias the aberrant examinee's test score while also jeopardizing the test scores of countless others. It is therefore crucial that aberrant examinees…

In this data brief, we examine the scores and pass rates for the Praxis School Psychologist tests (both Praxis 5402 and the newer version, Praxis 5403) by racial-ethnic group and gender for the period September 1, 2022 to August 31, 2023. The Praxis School Psychologist tests are the most often used external assessment of competency by school…

Purpose: This study aims at assessing item fairness in students' evaluation of teaching based on students' academic college using measurement invariance analysis (MI). Design/methodology/approach: The sample of this study consists of 17,270 undergraduate students from 12 different academic colleges. SET survey consists of 20 Likert-type items…