A study investigated the reliability and validity of the partial dictation test, a combination of dictation and cloze procedure, to measure foreign language listening comprehension. Subjects were 78 students of English as a Foreign Language in the second year of high school in Spain. Students listened to a passage from a commercial reader three…

The purpose of this study was to investigate the internal consistency reliability of the Stages of Concern Questionnaire (SoCQ) when the measure is administered to naive subjects as a pretest. The SoCQ was developed by G. E. Hall, A. A. George, and W. L. Rutherford (1979/1986). In the present study, the SoCQ was administered to secondary school…

The validity and reliability of aggregating individuals' perceptions of college organizational characteristics to more macro units of analysis were examined. The focus was the extent to which data collected in a national study met the internal consistency criterion for aggregating perceptual data to the institution level. The study assessed key…

In order to collect the necessary information on various practices and devices used in school climate assessment, 22 of the 39 school improvement projects mentioned in the Miles and Kaufman directory of effective schools programs were selected for a survey. A questionnaire was used to collect the primary data. Each program was asked for copies of…

With increasing reliance being placed on the results of their surveys, the National Center for Education Statistics (NCES) recognized a need for these survey results to be valid and reliable. As part of the work of the Statistical Analysis Group in Education (SAGE), an effort was undertaken to investigate validity and reliability in survey…

The Center for the Study of Evaluation's (CSE) expository and narrative rating scales have been developed to meet the need for instructionally relevant methods for assessing students' writing competence. Research indicates that large numbers of raters can be trained in the use of these scales and that, during training and independent rating, they…

This study examines the general hypothesis that surveys can be used to elicit reliable and valid student ratings of the effectiveness of most aspects of the delivery of the academic programs in which they are enrolled, and reports data on test-retest reliability for upper division majors as well as on the reliability with which ratings…

The Wechsler Intelligence Scale for Children-Revised (WISC-R), one of the most commonly used tests of cognitive ability, is difficult to administer accurately. The purpose of this study was primarily to assess interrater agreement on the WISC-R Administration Observational Checklist (WAOC), a new observational instrument that can be used by an…

Classroom researchers are frequently urged to provide evidence of the reliability of their data. In the case of observational data, three approaches to this have emerged: observer agreement, generalizability theory, and measurement error. Generalizability theory provides the most powerful approach given an adequate data collection design, but…

The Registered Holistic Scoring Method, which has been used for one year to score the ninth grade writing test of the New Jersey High School Proficiency Test, is described. Registered Holistic Scoring was developed from the previous holistic approach in order to provide more reliable scoring guidelines year after year. Two trained evaluators…

The Computer Attitude Scale (CAS) is a Likert-type instrument consisting of 30 items which present positively and negatively worded statements of attitudes toward computers and the use of computers. The CAS was subjected to three validation studies. The first study examined the reliability and factorial validity of the CAS and its subscales. The…

The Rosenberg Self-Esteem Inventory (RSE) is a 10-item scale purporting to measure self-esteem using self-acceptance and self-worth statements. This analysis covers concerns about the degree to which the RSE items represent a particular content universe, the RSE's applicability, factor analytic methods used, and the RSE's reliability and validity.…

The psychometric characteristics of the Graduate Record Examinations General Test (GRE-GT) were studied for three handicapped groups. Experimental subjects took the GRE-GT between October 1981 and June 1984; they include: (1) 151 visually-impaired students taking large-type, extended-time administrations; (2) 188 visually-impaired students taking…

Diagnostic testing can provide specific information about student skills as a decision-making aid to teachers in prescribing instruction, identifying needs for remediation, determining effective instructional materials and methods, and ultimately, improving student learning. Diagnostic testing, as viewed here, includes individual and group…

This panel presentation presents results of an assessment study of the reliability, validity, and utility of caregivers' reports on: (1) the behavioral competencies of severely handicapped children, and (2) the adaptive and intellectual behaviors of moderately handicapped children. The Kent Infant Development (KID) Scale (used with severely and…