Purpose: Several studies have demonstrated that dynamic assessment can be a less biased, valid approach for the identification of language disorder among diverse school-age children. However, all prior studies have included a relatively small number of participants, which is generally not adequate for psychometric research. This is the first…

Despite the emergence of test-optional policies, standardized admission tests continue shaping the college composition and financial aid prospects of hundreds of thousands of students. This is concerning for the following reasons: (a) standardized test results have historically favored test-takers from wealthier and majority backgrounds, (b) test…

Testing programs are confronted with the decision of whether to report individual scores for examinees that have engaged in rapid guessing (RG). As noted by the "Standards for Educational and Psychological Testing," this decision should be based on a documented criterion that determines score exclusion. To this end, a number of heuristic…

The indefinite nature of test fairness and different interpretations and definitions of the concept have stirred a lot of controversy over the years, necessitating the reconceptualization of the concept. On this basis, this study aimed to explore the empirical validity of Kunnan's (2008) Test Fairness Framework (TFF) and revisit the established…

Many schools now screen students for dyslexia in early grades. However, there are valid concerns that these screeners may be biased or ineffective at screening students who are not yet proficient in English (i.e., English Learners; ELs). The present study examined the performance of 54 first graders on a dyslexia screener. Results showed that…

An examination of gender-related differential item functioning was conducted on the verbal subtests of the Anadolu-Sak Intelligence Scale. Analyses were conducted using the scale standardization data (N = 4641). A Mantel-Haenszel statistic was used to detect differential item functioning (DIF). A total of 58 verbal analogical reasoning items, 20…

Aberrant behavior refers to any type of unusual behavior that would not be expected under normal circumstances. In educational and psychological testing, such behaviors have the potential to severely bias the aberrant examinee's test score while also jeopardizing the test scores of countless others. It is therefore crucial that aberrant examinees…

In this data brief, we examine the scores and pass rates for the Praxis School Psychologist tests (both Praxis 5402 and the newer version, Praxis 5403) by racial-ethnic group and gender for the period September 1, 2022 to August 31, 2023. The Praxis School Psychologist tests are the most often used external assessment of competency by school…

Practical constraints in rater-mediated assessments limit the availability of complete data. Instead, most scoring procedures include one or two ratings for each performance, with overlapping performances across raters or linking sets of multiple-choice items to facilitate model estimation. These incomplete scoring designs present challenges for…

The estimation of test score "gaps" and gap trends plays an important role in monitoring educational inequality. Researchers decompose gaps and gap changes into within- and between-school portions to generate evidence on the role schools play in shaping these inequalities. However, existing decomposition methods assume an equal-interval…

Purpose: This study aims at assessing item fairness in students' evaluation of teaching based on students' academic college using measurement invariance analysis (MI). Design/methodology/approach: The sample of this study consists of 17,270 undergraduate students from 12 different academic colleges. SET survey consists of 20 Likert-type items…

For assessment scales applied to different groups (e.g., students from different states; patients in different countries), multigroup differential item functioning (MG-DIF) needs to be evaluated in order to ensure that respondents with the same trait level but from different groups have equal response probabilities on a particular item. The…

This article examines the risk of crossover contamination in individual-level randomization, a common concern in experimental research, in the context of a large-enrollment college course. While individual-level randomization is more efficient for assessing program effectiveness, it also increases the potential for control group students to cross…

Studies across countries part of the Organization for Economic Cooperation and Development (OECD) suggest that learners' sense of school belonging is often influenced by their place of birth. However, large-scale assessment studies rarely explore whether differences in belonging scores between non-immigrant and immigrant learners are due to test…

This study investigated the differences between the ACTFL Oral Proficiency Interview (OPI) and the ACTFL Oral Proficiency Interview - Computer (OPIc) among Spanish learners at a U.S. university. Participants (N = 154) were randomly assigned to take both tests in a counterbalanced order to mitigate test order effects. Data were analyzed using an…