The Naglieri Nonverbal Ability Test (NNAT) was developed to more equitably identify students of color, as it advertises itself as a culture-fair measure. In this meta-analytic evaluation, we aimed to investigate: (1) the generalizability of validity evidence of NNAT by checking its construct and criterion validity with other measures (Part I); and…

The concept of large-scale assessment has long been on the concern of the education system worldwide. PISA, which is one of the large-scale international assessment, has been administered in a number of countries worldwide since 2000. When PISA was first launched, there was an "unconditional acceptance" of this new application worldwide,…

Achievement motivation is a well-documented predictor of a variety of positive student outcomes. However, given observed group differences in motivation and related outcomes, motivation instruments should be checked for comparable item and scale functioning. Therefore, the purpose of this study was to evaluate measurement scale comparability and…

One of the substantive changes in the 2014 Standards for Educational and Psychological Testing was the elevation of fairness in testing as a foundational element of practice in addition to validity and reliability. Previous research indicates that testing practices often do not align with professional standards and guidelines. Therefore, to raise…

Increasing linguistic diversity in classrooms has led researchers to examine the validity and fairness of standardized achievement tests, specifically concerning whether test score interpretations are free of bias and score use is fair for all students. This study examined whether mathematics achievement test items that contain complex language…

In line with the widespread proliferation of digital technology in everyday life, many countries are now beginning to use computer-based exams (CBEs) in their post-primary education systems. To ensure that these CBEs are delivered in a manner that preserves their fairness, validity, utility and credibility, several factors pertaining to their…

As the content knowledge of English language learners and immigrant students is assessed in their less proficient language, the validity and fairness of assessments related to those students have been widely discussed. However, such assessment issues have not received much attention in rapidly expanding bilingual education programmes, where…

To remove cultural bias is critical for the legitimacy of Programme for International Student Assessment (PISA) as an internationally reliable academic assessment. Since its inception, PISA has made extensive effort to address this issue by putting in place a range of methodological and procedural measures to ensure its test fairness. This study…

We examined whether English language proficiency (ELP) related to interim reading and math performance differently when academic assessments were administered to students in either English or Spanish. We also tested these effects with Spanish language proficiency (SLP) as well as jointly with ELP and SLP. Students from a midwestern suburban school…

Assessment is a useful process as it provides various stakeholders (e.g., teachers, parents, government, employers) with information about students' competence in a particular subject area. However, for the information generated by assessment to be useful, it needs to support valid inferences. One factor that can undermine the validity of…

We investigated whether consensus-based test translation review procedures can be used effectively in cultural contexts with high social stratification. We staged two test translation review panels in China -- where social stratification may potentially inhibit individuals' ability to express opinion and disagreement. We adapted a consensus-based…

Previous research has primarily addressed the effects of language on the Program for International Student Assessment (PISA) mathematics and science assessments. More recent research has focused on the effects of language on PISA reading comprehension and literacy assessments on student populations in specific Organization for Economic Cooperation…

The practice of measuring Indigenous achievement dates back to the early 1960s. Since then, Indigenous people have been subjected to a number of different standardized assessments intended to capture indicators of their well-being. Unfortunately, little attention has been given to the cultural appropriateness of subjecting Indigenous people to…

One urban district in the state of Arizona sought to use an alternative achievement test (i.e., the Northwest Evaluation Association's (NWEA) Measures of Academic Progress for Primary Grades (MAP)) to include more value-added ineligible teachers in the districts' growth and merit pay system. The goal was to allow for its K-2 teachers to be more…

International large-scale assessments are on the rise, with the Programme for International Student Assessment (PISA) seen by many as having strategic prominence in education policy debates. The present article reviews PISA-related English-language peer-reviewed articles from the programme's first cycle in 2000 to its most current in 2015. Five…