When evaluating student learning, educators often employ scoring rubrics, for which quality can be determined through evaluating validity and reliability. This article discusses the norming process utilized in a graduate organizational leadership program for a capstone scoring rubric. Concepts of validity and reliability are discussed, as is the…

One of the challenges in scoring constructed-response (CR) items and tasks is ensuring that rater drift does not occur during or across scoring windows. Rater drift reflects changes in how raters interpret and use established scoring criteria to assign essay scores. Calibration is a process used to help control rater drift and, as such, serves as…

The "GRE"® Psychology test is an achievement test that measures core knowledge in 12 content domains that represent the courses commonly offered at the undergraduate level. Currently, a total score and 2 subscores, experimental and social, are reported to test takers as well as graduate institutions. However, the American Psychological…

Educational Testing Service (ETS), working with 21 U.S. law schools, evaluated the predictive validity of the GRE® General Test using a sample of 1,587 current and graduated law students. Results indicated that the GRE is a strong, generalizably valid predictor of first-year law school grades and that it provides useful information even when…

Two experiments examine the psychometric effects of providing immediate feedback on the correctness of answers to open-ended questions, and allowing participants to revise their answers following feedback. Participants answering verbal and math questions are able to correct many of their initial incorrect answers, resulting in higher revised…

Administered the Attitudes Toward Disabled Persons (ATDP) scale to rehabilitation counseling graduate students (N=33) with instructions either to answer honestly or to fake a favorable attitude. Found scores significantly elevated under the faking condition. (Author/ABB)

A study of the long-term stability of Graduate Record Examination scores for graduate program admission purposes investigated the changes in scores among test repeaters. Results suggest that long-term test repeaters have greater gains on verbal than quantitative tests. Explanations and implications are considered. (MSE)

The psychometric characteristics of the Graduate Record Examinations General Test (GRE-GT) were studied for three handicapped groups. Experimental subjects took the GRE-GT between October 1981 and June 1984; they include: (1) 151 visually-impaired students taking large-type, extended-time administrations; (2) 188 visually-impaired students taking…

This study examined the score level, extent of test completion, and test reliability for visually impaired, physically handicapped, and nonhandicapped groups taking the Graduate Record Examinations General Test. Results included the finding that performance of visually handicapped groups approximated that of nondisabled examinees, although…

This investigation examines the impact the l98l Graduate Record Examination (GRE) General Test Format Revision had on the stability over time of the verbal, quantitative, and analytical scores. Scores were used from the self-selected group of repeaters who took the GRE General Test twice between October 1980 and June 1982. Examinees were divided…

This study was undertaken to determine whether additional information useful for guidance or placement could be derived from the existing Graduate Record Examinations (GRE) Advanced Psychology Test. The number of subscores currently reported is limited by the high reliability required to make admissions decisions; subscores used only for guidance…

Although reliability and validity are characteristics of test data, social scientists often attribute reliability and validity erroneously to the tests themselves. To determine the extent to which this problem exists, 150 reliability and validity studies selected from 3 prominent social science measurement journals over a 3-year period were…

This manual supplements previous guides to the use of the Graduate Record Examinations (GRE). It provides sufficient detailed information about the GREs to permit measurement specialists and institutional researchers, as well as faculty members and administrators, to understand the development of the tests and to evaluate their usefulness.…

Development and validation of the Ethical Climate Index, designed to measure perceived ethical climate of an institution's graduate and professional school programs, is described. The instrument was found to be valid and reliable, and variability was found in student perceptions of ethical climate across major academic areas. Research needs are…

Two coordinated studies involving 429 teachers and preservice teachers and 227 education graduate students were designed to develop and validate scores on an efficient self-report measure of multicultural awareness for teachers working in kindergarten through grade 12. The construct and criterion validity and reliability of the developed Teacher…