Conducted a reliability generalizability study on the Coopersmith Self-Esteem Inventory (CSEI; S. Coopersmith, 1967) to examine the variability of reliability estimates across studies and to identify study characteristics that may predict this variability. Results show that reliability for CSEI scores can vary considerably, especially at the…

Conducted a reliability generalization study on Zuckerman's Sensation Seeking Scale (M. Zuckerman and others, 1964) using 113 reliability coefficients from 21 published studies. The reliability of scores was marginal for four of the five scales, and low for the other. Mean age of subjects has a significant relationship with score reliability. (SLD)

Proposed a new asymptotic formula for estimating the sampling variance of a correlation coefficient corrected for unreliability and range restriction. A Monte Carlo simulation study of the new formula results in several positive conclusions about the new approach. (SLD)

Derived an approximate test and confidence interval for coefficient alpha and used the approximate test and confidence interval to derive closed-form sample size formulas that can be used to determine the sample size needed to test coefficient alpha with desired power or to test coefficient alpha with desired precision. (SLD)

This article provides a framework for reporting internal consistency reliability in counseling research and other related social science fields, including guidelines relative to score reliability coefficients and associated confidence intervals for both full sample and subgroups. Follow-up techniques for investigating low score reliability are…

Provides example applications of constrained principal component analysis (CPCA) that illustrate the method on a variety of contexts common to psychological research. Two new analyses, decompositions into finer components and fitting higher order structures, are presented, followed by an illustration of CPCA on contingency tables and the CPCA of…

States of 40 newborn infants were observed during 2, 35- to 70-minute periods that were separated by 6-48 hours. Analyses identified 3 state profiles that differentiated infants on a behavioral assessment measure at 2 weeks of age. Scores showed significant agreement on individual differences in neurologically based measures. (RH)

Sampling theory for the intraclass reliability coefficient, a Spearman-Brown extrapolation of alpha to a single measurement for each examinee, is less recognized and less cited than that of coefficient alpha. Techniques for constructing confidence intervals and testing hypotheses for the intraclass coefficient are presented. (SLD)

Similarity between pairs of scores with a common mean and variance can be expressed in terms of the absolute differences between them. The distribution of such absolute differences between pairs of normally distributed scores with a common mean and variance is discussed, with procedures for calculating moments and areas within this distribution.…

Describes the mastering and replication process for CD-ROMs. Costs are discussed, the production cycle of a CD-ROM is explained, packaging is described, testing to increase the reliability of discs is discussed, and a directory of mastering and replication facilities is provided. (LRW)

Proposes true score models that can account for correlated errors and their effect on coefficient alpha. These models allow random measurement errors on earlier items to affect directly or indirectly the scores on later items. Conditions under which coefficient alpha may yield spuriously high estimates or reliability are discussed. (SLD)

Standard-setting techniques concerning testing, comparisons of these techniques, and methods for assessing interrater and intrarater reliability are described. These techniques are discussed in relation to counselor education programs. (Author/MKA)

Reviews issues, raised in part because of "Educational and Psychological Measurement" (EPM) policies, regarding "test reliability," which is psychometric terminology, and "score reliability," score-centric terminology. Discusses datametrics and provides a critique of T. Vacha-Haase's proposed meta-analytic reliability generalization via…

Responds to criticisms of some "Educational and Psychological Measurement" policies and the reliability generalization meta-analytic methods of T. Vacha-Haase. Explores consequences of misunderstanding score reliability. (SLD)

B. Thompson and T. Vacha-Haase have examined the statement "the reliability of the test" with emphasis on the following three words: (1) the first "the"; (2) "test"; and (3) the second "the." This discussion focuses instead on the word "reliability." (Author)