The decision for high-stakes exams to be a core part of the admission process has not been without controversy. Current literature on standardized tests has focused on the bias associated with high-stakes exams and how Black students have historically scored low on these tests. Insufficient research exists on how a post-affirmative action and…

We use student-level administrative data from Delaware for 43,767 high school students across five 12th grade cohorts from 2017 to 2021. We apply Item Response Theory (IRT) to high school transcript data, treating courses as items and grades as ordered responses, to estimate both student transcript strength ([theta]) and course difficulty. We…

Fifteen years ago, Frey and Detterman established that the SAT (and later, with Koenig, the ACT) was substantially correlated with measures of general cognitive ability and could be used as a proxy measure for intelligence (Frey and Detterman, 2004; Koenig, Frey, and Detterman, 2008). Since that finding, replicated many times and cited extensively…

One of the major claims of the report of University of California's Task Force on Standardized Testing is that SAT and ACT scores are superior to high-school grades in predicting how students will perform at UC. This finding has been widely reported in the news media and cited in several editorials favoring UC's continued use of SAT/ACT scores in…

The problem was that testing instructions were normally presented as gains were more advantageous for promotion-oriented individuals, while testing instructions presented as losses were more advantageous for prevention-oriented. The purpose of this quantitative comparative study was to compare the performance on a measure of achievement for black…

On May 21, 2020, the University of California (UC) Board of Regents unanimously approved the suspension of the standardized test requirement (ACT/SAT) for all California freshman applicants until fall 2024. UC plans to create a new test that better aligns with the content the University expects students to have mastered for college readiness.…

Gender fairness in testing can be impeded by the presence of differential item functioning (DIF), which potentially causes test bias. In this study, the presence and causes of gender-related DIF were investigated with real data from 800 items answered by 250,000 test takers. DIF was examined using the Mantel-Haenszel and logistic regression…

In large-scale testing, the use of multigroup approaches is limited for assessing differential item functioning (DIF) across multiple variables as DIF is examined for each variable separately. In contrast, the item response theory with covariate (IRT-C) procedure can be used to examine DIF across multiple variables (covariates) simultaneously. To…

For more than seventy-five years, standardized tests have been considered a vital tool for gauging students' readiness for college. However, few people--including students, parents, teachers, and policy makers--understand how tests like the SAT or ACT are used in admissions decisions. Once touted as the best way to compare students from diverse…

The SAT is used for two purposes at the University of California. First is "eligibility": Determining whether applicants meet the minimum requirements for admission to the UC system. Second is "admissions selection": At high-demand campuses such as Berkeley, with many more eligible applicants than places available, test scores…

Proficiency with written communication (WC) is critical for success in college and careers. As a result, institutions face a growing challenge to accurately evaluate their students' writing skills to obtain data that can support demands of accreditation, accountability, or curricular improvement. Many current standardized measures, however, lack…

This study gathered quantitative and qualitative evidence concerning gender differences in performance by using critical reading material on the "SAT"® test with sports and science content. The fundamental research questions guiding the study were: If sports and science are to be included in a skills test, what kinds of material are…

The purpose of this document is to identify and dispel rumors that are frequently cited about the SAT. The following is a compilation of nine popular rumors organized into three areas: "Student Demographics," "Test Preparation/Test Prediction," and "Test Utilization."

We introduce the concept of "differential prediction generalization" in the context of college admissions testing. Specifically, we assess the extent to which predicted first-year college grade point average (GPA) based on high-school grade point average (HSGPA) and SAT scores depends on a student's ethnicity and gender and whether this…

The classification of test-takers into ethnic and racial groups ensures individuals and groups, identified in Title VI and VII of the Civil Rights Act of 1964 and the 14th Amendment to the Constitution of the United States, are protected from adverse treatment (Camilli, 2006). The United States Office of Management and Budget (OMB) suggests that…