In response to a call for research on using the SATs and ACTs for U.S.-based college and university admissions, researchers systematically interrogated the literature surrounding both tests, using a framework for validity evidence built upon the "Standards of Educational and Psychological Testing" and Kane's contemporary view of…

We analyze admissions and transcript records for students at multiple Ivy-Plus colleges to study the relationship between standardized (SAT/ACT) test scores, high school GPA, and first-year college grades. Standardized test scores predict academic outcomes with a normalized slope four times greater than that from high school GPA, all conditional…

Despite extensive research on assessing collocational knowledge, valid measures of academic collocations remain elusive. With the present study, we employ an argument-based approach to validate two Academic Collocation Tests (ACTs) that assess the ability to recognize and produce academic collocations (i.e., two-word units such as "key…

Cultural intelligence is one's ability to adapt when confronted with problems arising in interactions with people or artifacts of diverse cultures. In this study, we conduct an initial construct-validation and assessment of a maximum-performance test of cultural intelligence. We assess the psychometric properties of the test and also correlate the…

When applicants take the ACT® more than once, how do colleges and universities reconcile and make sense of the multiple scores? In terms of validity, fairness, and impact on subgroup differences, are certain score-use polices better than others? The focus of this issue brief is to summarize evidence on the validity and fairness of various…

Different uses of the ACT Assessment emphasize different intervals on its 1-36 score scale. Its use by colleges for applicant selection and course placement emphasize the middle and upper intervals of its score scale, and these uses have been extensively validated (ACT, 2019a). Its uses by school districts and state departments of education to…

The impetus for test-based accountability systems is to improve the educational opportunities afforded to all students so as to improve their learning; therefore, integral to the validity argument of these systems is the appraisal of test-based inferences and decisions in terms of their consequences. Both positive and negative consequences of…

The Every Student Succeeds Act requires that English Learners (ELs) are included in annual state testing (grades 3-8 and once in high school) and included in each state's accountability system disaggregated by subgroup to ensure that they receive the support they need to learn English, participate fully in their education experience, and graduate…

This study assessed the feasibility of using precollege success indicators to identify at-risk students at a large 4-year public research university in the Midwest. Retention data from students who participated in an established student success program were examined. The findings affirm that the initial admissions assessment identifying at-risk…

Compared with admissions test scores, why are high school grades better at predicting college graduation? We argue that success in college requires not only cognitive ability but also self-regulatory competencies that are better indexed by high school grades. In a national sample of 47,303 students who applied to college for the 2009/2010 academic…

In the context of college admissions, the current study examined whether differential prediction of first-year grade point average (FYGPA) by gender could be explained by an omitted variable problem--namely, academic discipline, or the amount of effort a student puts into schoolwork and the degree to which a student sees him/herself as hardworking…

High school GPAs (HSGPAs) are often perceived to represent inconsistent levels of readiness for college across high schools, while test scores (e.g., ACT scores) are seen as comparable. This study tests those assumptions, examining variation across high schools of both HSGPAs and ACT scores as measures of academic readiness for college. We find…

Computer-based testing is an expanding use of technology offering advantages to teachers and students. We studied Calculus II classes for science, technology, engineering, and mathematics majors using different testing modes. Three sections with 324 students employed: paper-and-pencil testing, computer-based testing, and both. Computer tests gave…

This chapter is a research summary of the author's doctoral dissertation completed in May, 2015, which investigates the way Standardized Assessment (SA) is used in state educational accountability structures. This quasi-experimental quantitative study found that SA scores trend towards consistency over time, and that there is additional variance,…

Proficiency with written communication (WC) is critical for success in college and careers. As a result, institutions face a growing challenge to accurately evaluate their students' writing skills to obtain data that can support demands of accreditation, accountability, or curricular improvement. Many current standardized measures, however, lack…