Fuzzy-set qualitative comparative analysis (fsQCA) has become one of the most prominent methods in the social sciences for capturing causal complexity, especially for scholars with small- and medium-"N" data sets. This research note explores two key assumptions in fsQCA's methodology for testing for necessary and sufficient…

Purpose: While numerous studies about academic performance that focused on only one factor, studies aiming to measure academicians' perceptions across many factors have not been observed in the literature. The current study aims to fill this gap and become a resource for upcoming studies. The aim of this study is to develop a valid and reliable…

Differential Item Functioning (DIF) analysis is a key element in evaluating educational test fairness and validity. One of the frequently cited sources of construct-irrelevant variance is gender which has an important role in the university entrance exam; therefore, it causes bias and consequently undermines test validity. The present study aims…

In this commentary, we discuss three types of data manipulations that can occur within teacher evaluation methods: artificial inflation, artificial deflation, and artificial conflation. These types of manipulation are more popularly known in the education profession as instances of Campbell's Law (1976), which states that the higher the…

The extant literature has largely ignored a potentially significant source of variance in multiple mini-interview (MMI) scores by "hiding" the variance attributable to the sample of attributes used on an evaluation form. This potential source of hidden variance can be defined as rating items, which typically comprise an MMI evaluation…

Ages & Stages Questionnaires: Social-Emotional (ASQ:SE) is a widely used screening instrument for detecting social-emotional difficulties in infants and young children. To use a screening instrument across cultures and countries, it is necessary to identify potential item-level biases and ensure item equivalence. This study investigated the…

The current simulation study examined the effects of Item Parameter Drift (IPD) occurring in a short scale on parameter estimates in multilevel models where scores from a scale were employed as a time-varying predictor to account for outcome scores. Five factors, including three decisions about IPD, were considered for simulation conditions. It…

The pupils' attitudes toward technology survey (PATT) has been used for 30 years and is still used by researchers. Since it was first developed, the validity of the questionnaire constructs has primarily been discussed from a statistical point of view, while few researchers have discussed the type of attitudes and interest that the questionnaire…

Culturally responsive evaluation and culturally responsive Indigenous evaluation (CRIE) within the broader field of evaluation are not often included in Western literature nor are they known or used by the majority of mainstream evaluators. In order to address this literature and practice gap, this article offers an overview and a broader origin…

This research examines how public school principals in seven U.S. states perceive the proficiency exam they must take and pass in order to evaluate their teachers. The test is centered on the states' primary teaching evaluation system, which is based on Charlotte Danielson's Framework for Teaching. An online survey was developed and 832 out of…

This study is within the framework of the United Nations sustainable development goals related to equitable quality education. The total score on the 2015 Trends in International Mathematics and Science Study that indicated eighth-grade girls in Jordan significantly outperformed boys is hiding many details related to the quality of mathematics…

Cognates are known to facilitate second language acquisition and use, as learners tend to assign to a new L2 word the meaning of a similar L1 word. Consequently, for L2 tests that rely largely on lexical items, performance may prove inflated for examinees whose L1 shares many cognates with the language being tested. This article examines the…

When typical pre-service teachers muse over classroom dynamics, they seldom pause to consider the fact that humanity exists in continua on several levels: their physical abilities, cognitive abilities, and culturally-enabled or -engendered abilities and "disabilities." For this reason, they need guidance in order to bridge their…

This article introduces practitioners and researchers to the topic of missing data in the context of differential item functioning (DIF), reviews the current literature on the issue, discusses implications of the review, and offers suggestions for future research. A total of nine studies were reviewed. All of these studies determined what effect…

This study established an effect size measure for differential functioning for items and tests' noncompensatory differential item functioning (NCDIF). The Mantel-Haenszel parameter served as the benchmark for developing NCDIF's effect size measure for reporting moderate and large differential item functioning in test items. The effect size of…