To score an essay response, raters draw on previously trained skills and knowledge about the underlying rubric and score criterion. Cognitive processes such as remembering, forgetting, and skill decay likely influence rater performance. To investigate how forgetting influences scoring, we evaluated raters' scoring accuracy on TOEFL and GRE essays.…

This study explored how the GRE Analytical Writing Section Discussion Forum, an informal online language learning community in China, functioned to support its members to improve their English writing proficiency. The Community of Inquiry (CoI) model was used as the theoretical framework to explore the existence of teaching presence, cognitive…

This study aimed at exploring the impact of mentor text modelling on Iranian English as a Foreign Language (EFL) learners' accuracy and fluency in writing tasks with different cognitive complexity in comparison with two conventional approaches to teaching writing; namely, process-based and product-based approaches. To this end, 60 Iranian EFL…

Free response and machine-scorable versions of a test called Formulating Hypotheses were compared with respect to construct validity. Results indicate that the different forms involve different cognitive processes and measure different qualities. (Author/JKS)

The objective description and identification of variables that meaningfully distinguish reasoning skills couched in written discourse was studied, comparing scores obtained from different perspectives on the same writing samples. A total of 406 writing samples on 2 topics by 203 students who had taken the Graduate Record Examinations, mostly…

The aim of this study was to develop a procedure that could be used to appraise the cognitive features of subject (achievement) tests. Cognitive taxonomies and an accompanying coding scheme were developed and applied to the Graduate Record Examinations subject tests in Psychology and Literature in English. The taxonomies were based on the manifest…

Graduate faculty in six fields of study judged (1) the importance for academic success of various analytical skills; (2) the seriousness of various reasoning errors; and (3) the degree to which "critical incidents" had affected their estimations of students' analytical abilities. (Author/MLW)

The comparability of computerized and paper-and-pencil tests was examined from cognitive perspective, using verbal protocols rather than psychometric methods, as the primary mode of inquiry. Reading comprehension items from the Graduate Record Examinations were completed by 48 college juniors and seniors, half of whom took the computerized test…

Differences in critical thinking between undergraduate and graduate students in the social and mathematical sciences was investigated using multiple measures of critical thinking that reflect different types of problem structure. Educational level and academic area differences were found across measures. (Author/MLW)

The construct validity of algebra word problems for measuring quantitative reasoning was examined, focusing on an analysis of problem attributes and on the analysis of constructed-response solutions. Constructed-response solutions to 20 problems from the Graduate Record Examinations (GRE) General Test were collected from 51 undergraduates.…

Recent assessment research joining cognitive psychology and psychometric theory has introduced a new technology, item generation. In algorithmic item generation, items are systematically created based on specific combinations of features that underlie the processing required to correctly solve a problem. Reading comprehension items have been more…

Three sections of the Graduate Record Examinations (GRE) Aptitude Test were reviewed before the introduction of the restructured test in October, 1977: research on (1) the GRE-Verbal section; (2) the GRE-Quantitative section; and (3) a planned third section, measuring analytical thinking skills. Research in all three areas focused on test…

This study planned further research aimed at understanding how the current version of the Graduate Record Examinations (GRE) analytical measure reflects cognitive skills that are important to success in graduate education. Several activities were completed, including selective literature reviews of: (1) cognitive and psychometric research on…

This monograph traces changes in computer science as a field of study in the college curriculum, and the associated changes in the work force and labor market. The study followed two cohorts of students from high school to age 30. Records for the first cover the period 1972-84; and for the second, the period 1982-93. The purpose of the study was…