In response to a call for research on using the SATs and ACTs for U.S.-based college and university admissions, researchers systematically interrogated the literature surrounding both tests, using a framework for validity evidence built upon the "Standards of Educational and Psychological Testing" and Kane's contemporary view of…

Current measures of student success fall short in capturing the nuanced and multiplicitous ways that underrepresented and misrepresented students (e.g., Latinx, first-generation college students) who are navigating the intersection of multiple contexts important to their identities (e.g., home communities and university), define and understand…

Over the past several years, content experts, psychometricians, and researchers have been hard at work developing, refining, and studying the digital SAT. The work is grounded in foundational best practices and advances in measurement and assessment design, with fairness for students informing all of the work done. This paper shares learnings from…

The SAT is used for two purposes at the University of California. First is "eligibility": Determining whether applicants meet the minimum requirements for admission to the UC system. Second is "admissions selection": At high-demand campuses such as Berkeley, with many more eligible applicants than places available, test scores…

Proficiency with written communication (WC) is critical for success in college and careers. As a result, institutions face a growing challenge to accurately evaluate their students' writing skills to obtain data that can support demands of accreditation, accountability, or curricular improvement. Many current standardized measures, however, lack…

Background: Much is still unknown or unclear about how and where validity issues arise in high stakes testing situations in education, and ways by which we can rectify validity problems in practice and policy contexts. Purpose: This paper is the Foreword to the Special Section in the "Teachers College Record," titled, "When…

This study examined the psychometric properties of the Personal Well-being Index for Adults (PWI-A), a measure of subjective well-being. The study used data from 533 high-ability American college students: honors students and participants in an early college entrance program. In earlier studies using the PWI-A, the instrument appeared to show…

Views on testing--its purpose and uses and how its data are analyzed--are related to one's perspective on test takers. Test takers can be viewed as learners, examinees, or contestants. I briefly discuss the perspective of test takers as learners. I maintain that much of psychometrics views test takers as examinees. I discuss test takers as a…

This study investigated the relationship of prompt characteristics and response features with essay scores on the SAT Reasoning Test. A sample of essays was coded on a variety of features regarding their length and content. Analyses included descriptive statistics and computation of effect sizes, correlations between essay features and scores, and…

This mixed-methods study reports psychometric properties of the 34-item Reasoning about P-values and Statistical Significance (RPASS) scale. RPASS is being designed as a research tool to assess effects of teaching methods on students' inferential reasoning. During development (Phase I), two graphical scenarios and 12 items were added to the scale,…

The purpose of this study is to apply the attribute hierarchy method (AHM) to a subset of SAT critical reading items and illustrate how the method can be used to promote cognitive diagnostic inferences. The AHM is a psychometric procedure for classifying examinees' test item responses into a set of attribute mastery patterns associated with…

Critics of educational admissions tests assert that tests measure nothing more than socioeconomic status (SES) and that their apparent validity in predicting academic performance is an artifact of SES. The authors examined multiple large data sets containing data on admissions and related tests, SES, and grades showing that (a) SES is related to…

Over the past four decades, there has been incremental growth in computer-based testing (CBT) as a viable alternative to paper-and-pencil testing. However, the transition to CBT is neither easy nor inexpensive. As Drasgow, Luecht, and Bennett (2006) noted, many design engineering, test development, operations/logistics, and psychometric changes…

Research has often found that, when high school grades and SAT scores are used to predict first-year college grade-point average (FGPA) via regression analysis, African-American and Latino students, are, on average, predicted to earn higher FGPAs than they actually do. Under various plausible models, this phenomenon can be explained in terms of…

Presented at the national conference for the American Educational Research Association (AERA) in April 2009. This study examined the utility of scores on the SAT writing test, specifically examining the reliability of scores using generalizability and item response theories. The study also provides an overview of current predictive validity…