Scores on essay-based assessments that are part of standardized admissions tests are typically given relatively little weight in admissions decisions compared to the weight given to scores from multiple-choice assessments. Evidence is presented to suggest that more weight should be given to these assessments. The reliability of the writing scores…

In an article in the Winter 2011 issue of the "Journal of Educational Measurement", van der Linden, Jeon, and Ferrara suggested that "test takers should trust their initial instincts and retain their initial responses when they have the opportunity to review test items." They presented a complex IRT model that appeared to show that students would…

With the pressing need for accountability in higher education, standardized outcomes assessments have been widely used to evaluate learning and inform policy. However, the critical question on how scores are influenced by students' motivation has been insufficiently addressed. Using random assignment, we administered a multiple-choice test and an…

Scores assigned by trained raters and by an automated scoring system (SpeechRater[TM]) on the speaking section of the TOEFL iBT[TM] were validated against a communicative competence criterion. Specifically, a sample of 555 undergraduate students listened to speech samples from 184 examinees who took the Test of English as a Foreign Language…

Exploratory and confirmatory factor analyses were used to explore relationships among existing item types and three new computer-administered item types for the analytical scale of the Graduate Record Examination General Test. Results with 349 students indicate constructs the item types are measuring. (SLD)

Students from 38 colleges with high scores on an advanced placement examination essay and low scores on the multiple-choice portion were compared with students with the opposite pattern. The pattern was not related to college grades, but was related to other test performance. (SLD)

This study at 21 colleges found that having entering freshmen write a short holistically scored essay added nothing to the prediction of freshman grade point average compared to predictions made from high school grade point average, Scholastic Aptitude Test scores, and a multiple-choice test of writing-related skills. (Author/DB)

Grades in college freshman English composition courses were predicted from high school rank in class, multiple-choice writing scores, essays, current Scholastic Aptitude Test (SAT) Verbal scores, and scores from a revised version of the SAT-Verbal. Data were obtained from 21 English courses at 17 different colleges with some supplementary data…

Examination of the correlation between multiple-choice and essay portions of the College Board Advanced Placement (AP) examinations with grades of first-year students from 32 colleges (largest sample=6,243) shows the best correlation for multiple choice tests for 2 examinations, with multiple choice and essay performing nearly equally for the…

Examinees in a regular administration of the quantitative portion of the Graduate Record Examination responded to particular items in a machine-scannable multiple-choice format. Volunteers (n=364) used a computer to answer open-ended counterparts of these items. Scores for both formats demonstrated similar correlational patterns. (SLD)

The Advanced Placement Program reports grades to students and colleges on a 1 to 5 point scale derived from combining the separate scores on the multiple-choice and free-response sections of Advanced Placement Examinations (ADPEs). In this study, predictions of grades in first-semester college biology courses were made based on students' separate…

The English Language Proficiency Test (ELPT) is a multiple-choice examination that is designed to assess the test taker's ability to use English in day-to-day interactions involving listening and reading. It is intended primarily as an admissions and placement test for college students with English as a second language. The ELPT consists of…

Essay and multiple-choice scores from Advanced Placement (AP) examinations in American History, European History, English Language and Composition, and Biology were matched with freshman grades in a sample of 32 colleges. Multiple-choice scores from the American History and Biology examinations were superior to essays for predicting overall grade…

Students with high scores (top third) on the essay portion of an Advanced Placement Examination (AP) (College Board) and low scores (bottom third) on the multiple-choice portion of the same examination were compared with students whose performance showed the opposite pattern. Across examinations in different subject areas (history, English, and…

A comprehensive review was conducted of writing research literature and writing test program activities in a number of testing programs. The review was limited to writing assessments used for admission in higher education. Programs reviewed included ACT, Inc.'s ACT™ program, the California State Universities and Colleges (CSUC) testing program,…