Analyses of 212 reports of crime incidents from the 1974 Portland, Oregon, victimization survey were conducted. These were matched with official crime reports of the same incidents. The record check described and analyzed the following: differences between survey and police data; the frequency of "don't know" responses; patterns of telescoping and…

In large-scale surveys, it is no longer uncommon for repeated measurements to be obtained from respondents and analyses performed to gauge the magnitiude of nonsampling errors. This is particularly true for periodic surveys and longitudinal surveys where a very large investment in data collection is made. This technical note, aimed at the analysis…

The examination of credibility effects in predicting achievement, an important step in the study of source credibility effects on attributions, substantiates Birnbaum's findings that variation in the credibility of information can be represented by changes in the weight of the information. Undergraduate subjects (N=65) predicted the performance of…

This paper describes generalizability theory as an extension to the analysis of variance approach to reliability which allows the researcher to attribute variation to multiple sources, and a number of reliability coefficients to be calculated for most observational contexts. The applications of generalizability coefficients to characterize the…

THIS STUDY EXAMINES A PROCEDURE FOR USING THE WRITTEN CASE RECORD AS A CRITERION FOR EVALUATING REHABILITATION COUNSELOR PERFORMANCE IN STATE "DVR" (STATE-FEDERAL GENERAL VOCATIONAL REHABILITATION PROGRAM) AGENCIES. THE RESEARCHERS OUTLINE CERTAIN OBJECTIVES (TECHNICAL, AGENCY SERVICES, AND STAFF DEVELOPMENT) AS DESIRABLE IN THE…

The well-meaning liberal male (WMLM) is a man who talks a liberal stereotype but behaves inconsistently with his professed beliefs. Using Ajzen and Fishbein's model of behavioral prediction based on attitudinal assessment, males identified as WMLM's, sincere liberals, and traditionalists from the Bem Sex Role Inventory (BSRI) were compared.…

A study of reading specialists conducted in 1977 revealed that their diagnostic reliability was very low. Mean diagnostic agreement between two clinicians on statements seen as characterizing a case was effectively zero. Mean agreement for one clinician's diagnostic statements on a case and its replicate over time was less than 0.23. In other…

This volume discusses the conceptualization and measurement of the health status of children (0 to 13 years of age) in terms of physical, mental, and social health and general health perceptions. The discussion is based on Health Insurance Study (HIS) questionnaire data collected from a sample of 8000 people (enrolled in one of the HIS insurance…

This study was designed to explore the practicality, flexibility, reliability, and sensitivity of the Criterion Group Method of measuring the effectiveness and efficiency of indexing, a method using a criterion group to set the standard for "ideal" indexing. These major variables were examined: (1) size of document sample, (2) size of…

The Privacy Act of 1974 places restrictions on the Federal, state and local agencies' use of the Social Security account number as an identifier. For some agencies, compliance will involve changes in implementation of retrieval algorithms. This report describes methodology applicable to these changes in the more general context of the problem of…

This study investigates the reliability and construct validity of a group administered test of Piaget's formal operations stage. A related problem involving a learning effect associated with Piaget's clinical methods is also investigated. The Piagetian Logical Operations Test (PLOT), a group-administered instrument, was developed and field-tested.…

The consistency across time and readers of the scoring of National Assessment of Educational Progress (NAEP) open-ended exercises was examined. The procedure studied is a nominal categorical scoring. Ten readers independently read 28 sample responses to each of 12 open-ended exercises at three different times. All ten readers agreed on their…

Although the evaluation of innovations in teacher training is often dependent on observational data, the problem of the reliability of the observations collected by a team of observers has often been treated in a superficial manner, partially because of the difficulties of maintaining an observer team intact over an extended period of time and of…

The purpose of this project was to investigate the feasibility, reliability and optimal procedures for using "practitioner consensus" as a means of identifying competent language arts instructors. Practitioner consensus was defined as agreement among professional personnel regarding instructors' level of competence. The professional personnel of…

The purpose of this project was to assess the degree to which the most popular method of calculating reliability of interval data, the I-I method, served the author's scientific purposes. Data were collected and analyses performed to assess the adequacy of I-I reliability scores in serving three functions: (1) as an index of how precise, clear,…