This study investigated potential item bias in a large-scale grade 3 reading achievement test, specifically against culturally diverse students with limited familiarity with mainstream Canadian culture. Students were classified based on their first language and length of residence in Canada, which was used as a proxy for cultural familiarity. A…

The objective of the study was to validate adapted versions of the Glasgow Anxiety Scale for people with Intellectual Disabilities (GAS-ID) simultaneously developed in English and French. A sample of 361 youth with mild to moderate intellectual disability (ID) (M = 15.78 years) from Australia (English-speaking) and Canada (French-speaking)…

The objective was to assess the psychometric properties of a French-Canadian version of the third edition of the Test of Gross Motor Development (TGMD-3). Participants were 127 French-speaking Canadian children. Results supported the validity-reliability of a bifactor exploratory structural equation modeling representation of the TGMD-3.…

The reporting of students' Learning Skills on the Ontario provincial report card provides educators and families with insight into students' work habits. However, the evaluation process is highly subjective. This study explores teachers' perceptions around student learning across demographic and institutional factors. This exploratory study is the…

This paper investigates measurement invariance as it relates to migration background using the Program for International Student Assessment measure of social belonging. We explore how the use of two measurement invariance techniques provide insights into differential item functioning using the alignment method in conjunction with logistic…

The null hypothesis test used in differential item functioning (DIF) detection tests for a subgroup difference in item-level performance--if the null hypothesis of "no DIF" is rejected, the item is flagged for DIF. Conversely, an item is kept in the test form if there is insufficient evidence of DIF. We present frequentist and empirical…

Comparing group is one of the key uses of large-scale assessment results, which are used to gain insights to inform policy and practice and to examine the comparability of scores and score meaning. Such comparisons typically focus on examinees' final answers and responses to test questions, ignoring response process differences groups may engage…

Classroom assessment has become a cornerstone of today's standards-based system of education. However, recent policy developments, professional standards, and variable assessment education have led to significant variability in teachers' approaches to assessment. The primary purpose of this research was to use a new instrument predicated on…

Increasing linguistic diversity in classrooms has led researchers to examine the validity and fairness of standardized achievement tests, specifically concerning whether test score interpretations are free of bias and score use is fair for all students. This study examined whether mathematics achievement test items that contain complex language…

Over eight thousand test administrations across two universities were examined to determine whether students with disabilities were being given the necessary extended testing time accommodations and whether their use of extended time decreased over the course of their programs. Findings revealed that commonly accepted recommendations about…

Differential item functioning (DIF) analyses have been used as the primary method in large-scale assessments to examine fairness for subgroups. Currently, DIF analyses are conducted utilizing manifest methods using observed characteristics (gender and race/ethnicity) for grouping examinees. Homogeneity of item responses is assumed denoting that…

In gender differential item functioning (DIF) research it is assumed that all members of a gender group have similar item response patterns and therefore generalizations from group level to subgroup and individual levels can be made accurately. However DIF items do not necessarily disadvantage every member of a gender group to the same degree,…

Differential test functioning, or DTF, occurs when one or more items in a test demonstrate differential item functioning (DIF) and the aggregate of these effects are witnessed at the test level. In many applications, DTF can be more important than DIF when the overall effects of DIF at the test level can be quantified. However, optimal statistical…

In recent years, large-scale international assessments have been increasingly used to evaluate and compare the quality of education across regions and countries. However, measurement variance between different versions of these assessments often posts threats to the validity of such cross-cultural comparisons. In this study, we investigated the…

The purpose of this research is to examine the comparability of mathematics and science scores for students from English language backgrounds (ELB) and non-English language backgrounds (NELB). We examine the relationship between English reading proficiency and performance on mathematics and science assessments in Australia, Canada, the United…