Generalizability Theory can be used to assess reliability in the presence of multiple sources and different types of error. It provides a flexible alternative to Classical Theory and can handle estimation of interrater reliability with any number of raters. (SK)

Dynamic generalizations of reliability and validity that will incorporate longitudinal or developmental models, using latent curve analysis, are discussed. A latent curve model formulated to depict change is incorporated into the classical definitions of reliability and validity. The approach is illustrated with sociological and psychological…

The clarification provided by Williams and Zimmerman on the reliability of gain scores is translated into recognizable patterns of change that tend to produce reliable or unreliable gain scores. The relevance of the traditional idea of reliability to the measurement of change is also discussed. (SLD)

Discusses problems in using traditional measures of reliability for criterion-referenced tests (CRTs) and describes two approaches to reliability for CRTs: estimates sensitive to all measures of error; and estimates of consistency in test outcome. Compares the two approaches and proposes recommendations for interpretation and use. (Author/LRW)

Designed an instrument to measure adolescents' attitudes toward school and teachers, goal-valuation, motivation, and general academic self-perceptions. Tested the developed survey with samples of 146, 200, and 299 high school students. Findings suggest the scale has adequate construct validity, criterion-related validity, and internal consistency…

Compares detection rates of the Referral Decision Scale (RDS) with a short, officer-administered booking questionnaire at a low capacity jail. Although RDS produced a higher number of false positives, it correctly identified more mentally ill inmates than did the booking procedure. Results suggest that combining both instruments may provide the…

Tests the properties of a Spanish version of the Family Adaptability and Cohesion Scales III (FACES III) in a Spanish sample. Confirmatory factor analyses replicated the factor structure of the original American version. Reliability coeffecients were higher for the cohesion than the adaptability scale. Convergent and discriminant validity was…

Two studies were conducted to develop and examine internal consistencies and validate the Abbreviated Multidimensional Acculturation Scale. Findings indicated good internal reliabilities for all 3 subscales. Adequate concurrent validity was established with length of residence in the United States. The scale also showed adequate convergent and…

Examined the asymptotic distributions of three reliability coefficient estimates: (1) sample coefficient alpha; (2) reliability estimate of a composite score following factor analysis; and (3) maximal reliability of a linear combination of item scores after factor analysis. Findings show that normal theory based asymptotic distributions for these…

Discusses the money wasted on ineffective training programs and the resulting surge in interest among training professionals in conducting learning evaluation and return on investment (ROI) measurement. Describes Kirkpatrick's four-level evaluation concept; questions regarding measurement validity and reliability; and new developments in learning…

Considers the degree of bias in testlet-based alpha (internal consistency reliability) through hypothetical examples and real test data from four tests of the Iowa Tests of Basic Skills. Presents a simple formula for computing a testlet-based congeneric coefficient. (SLD)

T. Vacha-Haase (1998) proposed her "reliability generalization" methodology to characterize (a) typical score reliability for a measure across studies, (b) the variability of score reliabilities, and (c) what measurement protocol features predict the variability in score reliabilities across administration. The present article provides…

Discusses the advantages of metal building and roofing systems, especially the use of steel. Considers such factors as installation ease and design flexibility, reliability and durability, and cost-effectiveness. (PKP)

Investigated the reliability and validity of the Borg and OMNI rating of perceived exertion (RPE) scales in adolescent girls during treadmill exercise. Girls were randomly assigned to one of the RPE scales during various treadmill exercise conditions. Results indicated that the OMNI cycle pictorial scale was reliable and valid for use with…

A measure, the Self-Injury Trauma Scale, is described for classifying and quantifying surface tissue damage. The scale permits differentiation of self-injurious behavior according to topography, location of the injury on the body, type of injury, number of injuries, and estimate of severity. High interrater reliability has been found. (Author/DB)