This meta-analysis examined the validity of an alternative to traditional assessments called the Wonderlic which is a brief measure of general mental ability. Our results showed significant, positive correlations between Wonderlic scores and academic performance in general ([r-bar] = 0.26), between Wonderlic scores and undergraduate GPA in…

In response to a call for research on using the SATs and ACTs for U.S.-based college and university admissions, researchers systematically interrogated the literature surrounding both tests, using a framework for validity evidence built upon the "Standards of Educational and Psychological Testing" and Kane's contemporary view of…

Cultural intelligence is one's ability to adapt when confronted with problems arising in interactions with people or artifacts of diverse cultures. In this study, we conduct an initial construct-validation and assessment of a maximum-performance test of cultural intelligence. We assess the psychometric properties of the test and also correlate the…

Fifteen years ago, Frey and Detterman established that the SAT (and later, with Koenig, the ACT) was substantially correlated with measures of general cognitive ability and could be used as a proxy measure for intelligence (Frey and Detterman, 2004; Koenig, Frey, and Detterman, 2008). Since that finding, replicated many times and cited extensively…

This article offers a critique of the validity argument put forward by Camara, Mattern, Croft, and Vispoel (2019) regarding the use of college-admissions tests in high school assessment systems. We challenge their argument in two main ways. First, we illustrate why their argument fails to address broader issues related to consequences of using…

Previous research has established that SAT scores and high school grade point average (HSGPA) differ in their predictive power and in the size of mean differences across racial/ethnic groups. However, the SAT is scaled nationally across all test takers while HSGPA is scaled locally within a school. In this study, the researchers propose that this…

Current measures of student success fall short in capturing the nuanced and multiplicitous ways that underrepresented and misrepresented students (e.g., Latinx, first-generation college students) who are navigating the intersection of multiple contexts important to their identities (e.g., home communities and university), define and understand…

Diagnostic tests for placing students into appropriate courses are commonly used in higher education math and science departments. We found no physics education research examining the validity of such exams, how well they are placing students into appropriate courses, and what guidance these exams can give for better focusing instruction. In this…

Policy makers, school practitioners, and scholars around the world have been searching for better school improvement models. The purpose of this study was to understand how an instrument we developed, Orientation to School Renewal, can be used to predict school-level academic achievement. We used the instrument to predict the academic performance…

The impetus for test-based accountability systems is to improve the educational opportunities afforded to all students so as to improve their learning; therefore, integral to the validity argument of these systems is the appraisal of test-based inferences and decisions in terms of their consequences. Both positive and negative consequences of…

Compared with admissions test scores, why are high school grades better at predicting college graduation? We argue that success in college requires not only cognitive ability but also self-regulatory competencies that are better indexed by high school grades. In a national sample of 47,303 students who applied to college for the 2009/2010 academic…

Extensive research has examined the validity and fairness of standardized tests in academic admissions. However, due to their underrepresentation in higher education, American Indians have gained much less attention in this research. In the present study, we examined for American Indian students (1) group differences on SAT scores, (2) the…

Relational reasoning is the foundational cognitive ability to discern meaningful patterns within an informational stream, but its reliable and valid measurement remains problematic. In this investigation, the measurement of relational reasoning unfolded in three stages. Stage 1 entailed the establishment of a research-based conceptualization of…

The study is designed to examine the predictive power of Saudi-admission criteria for student performance in an introductory biology course. It focuses on the second semester at King Saud bin Abdulaziz University for Health Sciences. The study addresses whether the General Aptitude test (GAT), the Scholastic Achievement Admission Test (SAAT), and…

We conducted two studies to replicate and extend, as well as test, the limits of previous findings regarding an apparent disconnect between scientific-reasoning skills in psychological science, on the one hand, and scores on standardized tests of general intelligence, on the other. In Study 1, we examined whether this disconnect would extend…