The idea of test consistency is illustrated, with reference to two sets of test scores. A mathematical model is used to explain the relative consistency and relative inconsistency of measurements, and a means of indexing reliability is derived using the model. Practical aspects of estimating reliability are considered. (TJH)

Identifies and evaluates alternative methods for weighting tests. Presents formulas for composite reliability and validity as a function of component weights and suggests a rational process that identifies and considers trade-offs in determining weights. Discusses drawbacks to implicit weighting and explicit weighting and the difficulty of…

Developed an index for assessing interrater agreement with respect to a single target using a multi-item rating scale. The variance of rater mean scale scores is used as the numerator of the agreement index. Studied four variants of a disattenuated agreement index that vary in the random response term used as the denominator. (SLD)

Investigated how dissimilar in composition and variability samples inducting reliability coefficients from prior studies were from the cited prior samples from which coefficients were generalized. Results from 20 articles show that citing reliability coefficients from prior studies as the basis for concluding new scores are reliable is only…

Provides a sample of seven published studies in different disciplines that inappropriately generalized reliability coefficients involving several raters to scores generated by a single rater. Score reliability when only one rater is used for scoring is lower than the score reliability for which two raters are used. (SLD)

Describes the development of the Moral Justification Scale, an objective measure of justice and care orientations. The scale was administered to 100 college students. Results imply that the Moral Justification Scale shows promise as an easily administered, objectively scored measure of Giligan's constructs of care and justice. (Author/MKA)

The population discrepancy between Cronbach's Coefficient Alpha (L. Cronbach, 1951) and scale reliability with fixed congeneric measure, uncorrelated errors, and sampling of subjects was studied. The difference is expressed in terms of the individual component violations of the assumption of equal tau-equivalence that is necessary and sufficient…

A number of school-based programs address sexual violence by focusing on adolescents' attitudes about rape or acceptance of rape myths. However, really problems exist in the literature regarding measurement of rape myth acceptance, including issues of reliability and validity. This paper addresses measurement reliability issues and reviews…

We make theoretical comparisons among five coefficients--Cronbach's [alpha], Revelle's [beta], McDonald's [omega][sub h], and two alternative conceptualizations of reliability. Though many end users and psychometricians alike may not distinguish among these five coefficients, we demonstrate formally their nonequivalence. Specifically, whereas…

A covariance structure modeling perspective on reliability estimation can be used to construct a formal approach to estimation of reliability in multilevel models. This article presents a didactic discussion of the relation between a structural modeling procedure for scale reliability estimation and the notion of reliability of observed means in…

The objectives of this study were: (1) to examine the psychometric properties of the Assessment of Life Habits (LIFE-H) for children; and (2) to draw a profile of the level of participation among children of 5 to 13 years of age with various impairments. The research team adapted the adult version of the LIFE-H in order to render it more…

The "Social-Communication Assessment Tool" (S-CAT) was created as a direct observation instrument to quantify specific social and communication deficits of children with autism spectrum disorders (ASD) within educational settings. In this pilot study, the instrument's content validity and interrater reliability were investigated to determine the…

The purpose of this study was to produce a typology of behavior problems in preschool children. Distinct subtypes were identified through the use of cluster analytic techniques on data from the Behavior Assessment System for Children (BASC)--Parent Rating Scales. Analyses were based on archival data collected on a sample of 268 children, aged 2 to…

The purpose of this study was to develop and establish the validity and reliability of an instrument to measure students' attitudes toward geometry. Participants consisted of 264 undergraduate students from two universities, one in the Midwest and one in the Southwest. The instrument is a 5-point Likert-scaled survey consisting of 32 statements…

This study is the first to examine the latent structure of individual differences reflected in the Adult Attachment Interview (AAI; C. George, N. Kaplan, & M. Main, 1985), a commonly used and well-validated measure designed to assess an adult's current state of mind regarding childhood experiences with caregivers. P. E. Meehl's (1995)…