In this research report, we present an empirical argument for the use of a contributory scoring approach for the 2-essay writing assessment of the analytical writing section of the "GRE"® test in which human and machine scores are combined for score creation at the task and section levels. The approach was designed to replace a currently…

Purpose: Graduate admission has become a critical process for quality assurance in tertiary education. Hitherto, most research has investigated the validity of admissions instruments. However, surprisingly little work has been conducted on the overall organization of admission, which often remains "informal, ad hoc, and lacking in…

Multitiered frameworks of service delivery have traditionally underserved students with mental health needs. Whereas research has supported the assessment and intervention of social and academic behavior across tiers, evidence is limited with regard to mental health concerns including internalizing behaviors (e.g., anxiety and depression). In…

In many testing programs it is assumed that the context or position in which an item is administered does not have a differential effect on examinee responses to the item. Violations of this assumption may bias item response theory estimates of item and person parameters. This study examines the potentially biasing effects of item position. A…

Secondary data on 1,028 graduate students nested within 24 programs and admitted into either a Ph. D. or Ed. D. program between 1990 and 2006 at an American public university were used to illustrate the benefits of employing multilevel discrete-time hazard analysis in understanding the timing of doctorate completion in Education and the factors…

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…

The aim of this research was to identify, develop, and evaluate empirically new reasoning item types that might be used to broaden the analytical measure of the Graduate Record Examinations (GRE) General Test and to strengthen its construct validity. Six item types were selected for empirical evaluation, including the two currently used in the GRE…

This report examines the belief that education administration (EA) has attracted students of below-average verbal, quantitative, and analytic scores, as measured by standardized tests. The paper makes two assertions: principals as school leaders need academic credibility to relate with teachers as "critical friends," and successful…

A wide variety of potential indicators of graduate student performance are reviewed. Based on research literature, experience with recent and current research projects, and conversations with graduate faculty members and administrators, the various indicators are considered in two ways. First, they are analyzed within the framework of the…

A previous study of new item types for the analytical measure of the Graduate Record Examinations (GRE) General Test found that the new items had many factors labeled verbal reasoning, informal reasoning, formal-deductive reasoning, and quantitative reasoning. The present study examined how processing differed for these item types in the context…

This study was designed to analyze the relationship of Graduate Record Examination (GRE) scores to applicants' choices of institutions, their admission, and their enrollment. Applicants from four fields were followed up the year after they had taken the GRE tests. Information was obtained about the departments to which the test takers applied and…

The stability was evaluated of a partial correlation index, comparisons of item characteristic curves, and comparisions of item difficulties in assessing race and sex differences in the performance of verbal items on the Graduate Record Examination Aptitude Test. All three indexes exhibited consistency in identifying the same items in different…

Time limits on tests often prevent some examinees from finishing all of the items on the test; the extent of this effect has been called the "speededness" of the test. Traditional speededness indices focus on the number of unreached items. Other examinees in the same situation rapidly fill in answers in the hope of getting some of the…

Four writing samples were obtained from 638 foreign college applicants who represented three major foreign language groups (Arabic, Chinese, and Spanish), and from 60 native English speakers. All four were scored holistically, two were also scored for sentence-level and discourse-level skills, and some were scored by the Writer's Workbench…