This study aimed to translate the modified Group Environment Questionnaire (GEQ) and the Youth Sport Environment Questionnaire (YSEQ) into Norwegian, examine the factor structure and reliability of the scales through independent clusters model confirmatory factor analysis (ICM-CFA) and exploratory structural equation modeling (ESEM), and examine…

Scoring constructed-response items can be highly difficult, time-consuming, and costly in practice. Improvements in computer technology have enabled automated scoring of constructed-response items. However, the application of automated scoring without an investigation of test equating can lead to serious problems. The goal of this study was to…

The present study explores the use of Student Evaluations of Teaching (SETs) within higher education institutions. In particular, bias associated with student ratings was explored in several ways. An experimental study design, using an advanced measurement framework was employed. Eight faculty participants from four ethnic-identity groups, and two…

The 2015 Every Student Succeeds Act (ESSA) emphasized that students, regardless of group membership, should graduate ready for college or work. The economic impact of not being ready is significantly negative. Non-cognitive skills (NCSs) assessments have been used to identify students at risk and intervene to help prevent undesirable outcomes.…

Growing interest in interdisciplinary (ID) understanding has led to the recent development of four ID assessments, none of which have previously been comprehensively validated. Sources of evidence for the validity of tests include construct validity, such as the internal structure of the test. ID tests may (and should) test both disciplinary (D)…

Northern Virginia Community College (NOVA), like other community colleges, does not require Scholastic Assessment Test (SAT) scores or similar entrance examinations for admission. However, new college applicants must demonstrate their levels of reading, writing, and mathematics skills to determine whether they need developmental courses to prepare…

When contextual features of test-taking environments differentially affect item responding for different test takers and these features vary across test administrations, they may cause differential item functioning (DIF) that varies across test administrations. Because many common DIF detection methods ignore potential DIF variance, this article…

At a time when institutions of higher education are exploring alternatives to traditional admissions testing, institutions are also seeking to better support students and prepare them for academic success. Under such an engaged model, one may seek to measure not just the accumulated knowledge and skills that students would bring to a new academic…

We derive formulas for the differential item functioning (DIF) measures that two routinely used DIF statistics are designed to estimate. The DIF measures that match on observed scores are compared to DIF measures based on an unobserved ability (theta or true score) for items that are described by either the one-parameter logistic (1PL) or…

This study examined the effect of sample size ratio and model misfit on the Type I error rates and power of the Difficulty Parameter Differences procedure using Winsteps. A unidimensional 30-item test with responses from 130,000 examinees was simulated and four independent variables were manipulated: sample size ratio (20/100/250/500/1000); model…

When evaluating the quality of any screening tool, it is important to determine whether or not the assessment is biased against different groups of students. We want to ensure that students do not receive higher or lower scores on an assessment for reasons other than the primary skill or trait that is being tested.

Multilingual children represent a rapidly growing population of students in U.S. schools. However, identification of language and learning disabilities for students from different linguistic backgrounds is complex, leading to frequent misidentification of multilingual learners for special education. This article provides guidance on how special…

Creativity has been well studied in the past several decades, and numerous measures have been developed to assess creativity. However, validity evidence associated with each measure is often mixed. In particular, the social consequence aspect of validity has received little attention. This is partly due to the difficulty of testing for…

Overidentification of minority students in special education is a significant concern. It is imperative that the districts effectively train professionals who administer testing for qualification of special education. The purpose of this qualitative case study was to discover why minority students are disproportionately enrolled in special…

Performance assessments heavily rely on human ratings. These ratings are typically subject to various forms of error and bias, threatening the assessment outcomes' validity and fairness. Differential rater functioning (DRF) is a special kind of threat to fairness manifesting itself in unwanted interactions between raters and performance- or…