The consistency between raters over three years of a high-stakes performance assessment was examined in two studies involving a total of approximately 3,000 students in grades three, five, and eight. Results show that raters in different years differ in severity, with raters in mathematics most consistent, and those in language arts least…

Examines the internal consistency reliabilities for 14 previously-published computer attitude scales based on responses from preservice teachers, practicing K-12 teachers, and teacher educators. Describes the Teachers' Attitude toward Computers Questionnaire (TAC) that included 32 subscales. (LRW)

Examined differences in performance as well as reliability and validity indices for 256 Head Start children screened with Brigance K&1 screen. Found high overall test consistency, but considerable variability across subscales. Classification analyses established that the Brigance was not completely accurate in predicting early school…

Studied the internal structure of a self-report measure of depressed mood in school children, the Child Depression Inventory (M. Kovacs and A. Beck, 1977) with 92 Russian and 139 English children (mean age: 12 years, 10 months). Internal reliability and consistency results and factor analysis support the use of the scale with non-Western samples…

Examines the psychometric properties of scores on the Work Preference Inventory (WPI), particularly its factor structure and scale reliabilities. Analyses of data from 200 undergraduates showed qualified support for the inventory and its use for developmental purposes. States that the WPI may be a useful tool in stimulating students to examine…

Describes a classroom activity, listing step-by-step directions, that demonstrates the unreliability of essay scoring. Explains that after the exercise the class discussion should address the problematic factors in scoring essays. Lists recommendations for improving reliability and validity of essay scoring. (CMK)

Discusses the basic concepts of testing and item development and the application of alternative assessments to information literacy content for library instruction. Topics include reliability; validity; statistical analysis; selected response, including checklists, rank order, or simple match; constructed response; essays; and complex assessments.…

Multiple observer ratings of 424 families were obtained across 2 observational task situations using the Iowa Family Interaction Rating Scales. Observer ratings and family member reports were assessed simultaneously through structural equation modeling. Findings support the reliability of the global assessments of warm/supportive marital…

Describes an investigation of the relationship between the levels of interlinker consistency obtained among a group of full-text databases in which internodal links were inserted, and the effectiveness of searches carried out in those databases. Topics include interindexer consistency and retrieval system evaluation. (Author/LRW)

A study of 187 internists, evaluated by peers they recommended, found the highest rating was for integrity, and lowest was for psychosocial aspects of patient care. Peer raters' response rate and analysis of the ratings suggest this rating process is acceptable to physicians and that it is feasible to obtain reliable, multidimensional peer…

Evaluation of two meta-analyses of sociometric research on children with learning disabilities notes differences in their findings. Differences are attributed to effects of gender, ethnicity, and type of measurement on effect size; inadequate reporting of coding reliability; failure to include similar articles for analysis; and poor…

A self-report, paper-and-pencil version of the Hamilton Depression Rating Scale, the Hamilton Depression Inventory, was developed and tested with 140 depressed adults, 99 adults with anxiety disorders, and 118 nonreferred adults. Overall, data support the reliability and validity of the new measure. (SLD)

Guidelines are offered that make it more likely that high-quality information will be extracted and coded from primary research reports in meta-analyses. It is also noted that the methodology of meta-analysis results in pressure to change the type of information that appears in primary research reports. (SLD)

Outlines the conceptual background and development of the Leisure Competence Measure, a behavior-anchored rating scale which documents current levels of leisure functioning and change over time. Validation with a geriatric rehabilitation population supports it as an instrument from which researchers can draw dependable inferences regarding leisure…

This paper reports the psychometric properties of each of the subscales of the Youth Health Survey and results of a pilot study with 205 sixth-, seventh-, and eighth-grade students. The eight subscales assess health habits and attitudes of the adolescent as well as peer and family influences. Data for internal consistencies, test-retest…