A desirable goal would be to develop a methodology for scoring essays so that the final grades are less affected by when or by whom each essay was read. It seems sensible to derive such grades by somehow adjusting the ratings originally given by each reader. This essay describes a solution that relies on statistical adjustment, using the context…

A special case of examinee choice, the Optional Essay Problem, is examined from the point of view of test equating. The Optional Essay Problem involves equating essay scores when the examinees are required to select an optional essay topic from a list of topics in addition to taking a mandatory test required of all examinees. The conditions that…

This report describes a statistically designed experiment that was carried out in an operational setting to determine the contributions of different sources of variation to the unreliability of scoring. The experiment made novel use of partially balanced incomplete block designs that facilitated the unbiased estimation of certain main effects…

This guide to effective writing strategies is based on three ideas that provide motivation for writing skills development in an advanced placement history class: students learn to write by writing; problem essays are more effective in developing writing skills than topic essays; and writing is a learning tool. Stressing that writing practice is…

If a student writes two essays, the score reliability can be estimated from the correlation between essays. However, if the essays are in different modes or require different skills, the reliability may be underestimated from the correlation. In Advanced Placement history examinations, students wrote one standard essay and one essay that required…

A case is presented for adjusting the scores for free response items in the Advanced Placement (AP) tests. Using information about the rating process from the reliability studies, administrations of the AP test for three subject areas, psychology, computer science, and English language and composition, are analyzed. In the reliability studies, 299…

This study assessed the ability of high school advanced placement history students to choose the essay topic on which they can get the highest score. A second, equally important, question was whether the score on the chosen topic was more highly related to other indicators of proficiency in history than the score on the unchosen topic. Overall,…

It has been found that when examinees are allowed to choose a subset of constructed response (CR) items to answer on a test, they tend to choose differently and often perform lower on more popularly chosen items. The purpose of this study was to examine this finding. Using an experiment that incorporated a revised Advanced Placement (AP) Chemistry…

Examination of the correlation between multiple-choice and essay portions of the College Board Advanced Placement (AP) examinations with grades of first-year students from 32 colleges (largest sample=6,243) shows the best correlation for multiple choice tests for 2 examinations, with multiple choice and essay performing nearly equally for the…

The Advanced Placement Program reports grades to students and colleges on a 1 to 5 point scale derived from combining the separate scores on the multiple-choice and free-response sections of Advanced Placement Examinations (ADPEs). In this study, predictions of grades in first-semester college biology courses were made based on students' separate…

Essay and multiple-choice scores from Advanced Placement (AP) examinations in American History, European History, English Language and Composition, and Biology were matched with freshman grades in a sample of 32 colleges. Multiple-choice scores from the American History and Biology examinations were superior to essays for predicting overall grade…

Reports on the rationale and processes behind the composition and evaluation of the Advanced Placement European History examination, focusing special attention on changes introduced in 1994. Discusses reasons for adding an additional thematic essay for the 1994 test. (CFR)

Students with high scores (top third) on the essay portion of an Advanced Placement Examination (AP) (College Board) and low scores (bottom third) on the multiple-choice portion of the same examination were compared with students whose performance showed the opposite pattern. Across examinations in different subject areas (history, English, and…