A study was designed to (1) compare two types of reliability in the observation of teachers' behavior, (2) explore the relationship between observer reliability and the validity of their systematic classroom observations, and (3) investigate the effects of training, observer beliefs, and the passage of time on reliability and validity estimates.…

Research on child influence upon parent behavior motivated the development of a Parent Report of Child Behavior Toward the Parent Inventory. Internal consistency reliabilities of 31 five-item scales ranged from .69 to .95 with a median of .88. Varimax rotation of three principal component factors yielded dimensions of Control, Acceptance versus…

An independent engineering evaluation was conducted of the Optical to Tactile Converter (Optacon), a reading aid for the blind which senses the contrast of printed text and converts the information into a tactile presentation. Tasks performed included: user evaluation, optical, electrical, mechanical, production costs, life tests, reliability, and…

A course-instructor evaluation form, specifically adapted for this study, was administered to 775 undergraduates in 15 large and small section introductory courses after the second class meeting and again near the end of the semester. The median pretest posttest correlation was +.60. Although there were many systematic changes, students were…

In an earlier pilot study of the narrative sections of Navy performance evaluations for senior enlisted personnel in pay grade E-7, it was determined by content analytic techniques that it is possible to differentiate between the performance of typical and superlative chief petty officers based on the narrative content of Evaluation Reports. A…

General systems for analyzing instructional interaction have found the most common teacher behavior to be asking questions. This evaluation compares and contrasts two systems for analyzing teacher questions: Price-Belland, developed by the authors from the Bloom-Saunders tradition, and Hough-Duncan, modified for detailed question analysis.…

A study was conducted by the Navy to develop and evaluate human performance reliability estimates for electronic maintenance. Data were collected using the Personnel Identification Information Forms, the Technical Proficiency Checkout Form, and the Job Performance Questionnaire. On the basis of the total number of uncommonly effective and the…

The use of a short, face valid, objectively scorable questionnaire to obtain students' evaluations of courses as a whole is discussed. The instrument is described from the standpoints of content domain, reliability, face validity, and university-wide applicability. This instrument would provide reliable normed data for use by campus-level…

Ten criteria for use in assessing the emphasis on environmental education in textbooks and similar resource materials were developed and given to 30 members of the Australian Conservation Foundation Education and Training Committees throughout the country. Each rater applied the criteria to three chapters of a biology textbook "The Web of…

The P.E.P. Report 1969-1973 focuses on the various findings and activities of the Program Evaluation Project. Followup is an integral part of a goal oriented evaluation, providing the opportunity for the collection of various forms of outcome data as well as consumer satisfaction information. This chapter discusses the history and implementation…

The P.E.P. Report 1969-1973 focuses on the various findings and activities of the Program Evaluation Project. Reliability is considered a basic aspect of any measurement system. With Goal Attainment Scaling, at least two types of reliability are important: the reliability of the followup guide construction and the reliability of the followup guide…

The Career and Occupational Development (COD) assessment of the National Assessment of Educational Progress (NAEP) was made up of about 70 percent free response exercises requiring hand scoring. This paper describes the techniques used in developing the "scoring guides" for these exercises and summarizes the results of two empirical…

Difficulties involved with the evaluation of drug abuse prevention programs are numerous. Tentative Drug Use Scale (TDUS) was designed in response to a number of specific problems associated with obtaining behavioral data. Advantages of this scale over others are discussed. Reliability and validity information are provided. (Author)

An inventory was constructed to screen children for psychiatric impairment. Factor analysis of the questionnaire items of child behavior yielded 18 factors. The 7 factors with the highest correlations with total psychiatric impairment were selected for the inventory, each represented by 5 items. (Author)

This note shows that, under conditions specified by Levin and Subkoviak (TM 503 420), it is not necessary to specify the reliabilities of observed scores when comparing completely randomized designs with randomized block designs. Certain errors in their illustrative example are also discussed. (Author/CTM)