In this research report, we present an empirical argument for the use of a contributory scoring approach for the 2-essay writing assessment of the analytical writing section of the "GRE"® test in which human and machine scores are combined for score creation at the task and section levels. The approach was designed to replace a currently…

Purpose: Graduate admission has become a critical process for quality assurance in tertiary education. Hitherto, most research has investigated the validity of admissions instruments. However, surprisingly little work has been conducted on the overall organization of admission, which often remains "informal, ad hoc, and lacking in…

Multitiered frameworks of service delivery have traditionally underserved students with mental health needs. Whereas research has supported the assessment and intervention of social and academic behavior across tiers, evidence is limited with regard to mental health concerns including internalizing behaviors (e.g., anxiety and depression). In…

In many testing programs it is assumed that the context or position in which an item is administered does not have a differential effect on examinee responses to the item. Violations of this assumption may bias item response theory estimates of item and person parameters. This study examines the potentially biasing effects of item position. A…

Secondary data on 1,028 graduate students nested within 24 programs and admitted into either a Ph. D. or Ed. D. program between 1990 and 2006 at an American public university were used to illustrate the benefits of employing multilevel discrete-time hazard analysis in understanding the timing of doctorate completion in Education and the factors…

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…

A generic approach in automated essay scoring produces scores that have the same meaning across all prompts, existing or new, of a writing assessment. This is accomplished by using a single set of linguistic indicators (or features), a consistent way of combining and weighting these features into essay scores, and a focus on features that are not…

Assessing student attainment in the major field of study is increasingly important to employers and accrediting bodies alike. Construction and manufacturing firms do not like engineers who design faulty bridges and airplanes. Marketing firms want to hire students who understand the difference between a niche market and a global market. School…

Discusses whether scores achieved by college seniors on standardized tests such as Graduate Record Examination can express collegiate value added (knowledge, skills, and abilities added to students during undergraduate studies). Encourages professional organizations to serve as forums to arrive at consensus on how to explain efficacy of…

Defines assessment as finding out where the problems are in a program for the purpose of eliminating them. Presents a method for developing a formal assessment plan in history including principles of assessment, program goals, and objectives. Suggests determining what is already done and what further assessment methods are desired. (DK)

The stability was evaluated of a partial correlation index, comparisons of item characteristic curves, and comparisions of item difficulties in assessing race and sex differences in the performance of verbal items on the Graduate Record Examination Aptitude Test. All three indexes exhibited consistency in identifying the same items in different…

Describes the development of a history assessment test by Northeast Missouri State University (Kirksville) faculty. Discusses content, problems with design and cooperation, and theories of assessment testing. Includes sample questions demonstrating the cube plan, a technique that involves using a single question to measure three learning…