Test homogeneity and internal consistency reliability indices were developed on the basis of theoretical considerations of properties of hierarchical structures of data matrices. This reconceptualization, in terms of ordinal test theory, has potential for explication of the mutual relationship of test reliability and homogeneity. (TJH)

Examined reliability of United States Employment Service Interest Inventory (USES-II) by twice administering USES-II to 100 vocational rehabilitation clients. Retest reliability coefficients for the 12 scales of the USES-II ranged from .73 to .88 with a median of .83 for this population. Findings support use of USES-II in occupational exploration…

Sampling theory for the intraclass reliability coefficient, a Spearman-Brown extrapolation of alpha to a single measurement for each examinee, is less recognized and less cited than that of coefficient alpha. Techniques for constructing confidence intervals and testing hypotheses for the intraclass coefficient are presented. (SLD)

Similarity between pairs of scores with a common mean and variance can be expressed in terms of the absolute differences between them. The distribution of such absolute differences between pairs of normally distributed scores with a common mean and variance is discussed, with procedures for calculating moments and areas within this distribution.…

Describes the mastering and replication process for CD-ROMs. Costs are discussed, the production cycle of a CD-ROM is explained, packaging is described, testing to increase the reliability of discs is discussed, and a directory of mastering and replication facilities is provided. (LRW)

Published Lester Attitude toward Death Scale for first time, together with data on its reliability and validity. Notes that scale is different from other fear of death scales in its use of scaled value approach that permits measure of inconsistency in attitudes. (Author)

An approach is presented that can predict internal consistency of cognitively complex assessments on two dimensions, those of adding tasks with similar or different solution strategies and adding test takers with different solution strategies. Data from the 1992 National Assessment of Educational Progress mathematics assessment are used to…

Describes a Statistical Analysis System (SAS) MACRO for computing various indices of interrater agreement, including a new generalizability coefficient, for categorical data in a single-facet, crossed design. (Author/SLD)

Proposes true score models that can account for correlated errors and their effect on coefficient alpha. These models allow random measurement errors on earlier items to affect directly or indirectly the scores on later items. Conditions under which coefficient alpha may yield spuriously high estimates or reliability are discussed. (SLD)

Standard-setting techniques concerning testing, comparisons of these techniques, and methods for assessing interrater and intrarater reliability are described. These techniques are discussed in relation to counselor education programs. (Author/MKA)

Reviews issues, raised in part because of "Educational and Psychological Measurement" (EPM) policies, regarding "test reliability," which is psychometric terminology, and "score reliability," score-centric terminology. Discusses datametrics and provides a critique of T. Vacha-Haase's proposed meta-analytic reliability generalization via…

Responds to criticisms of some "Educational and Psychological Measurement" policies and the reliability generalization meta-analytic methods of T. Vacha-Haase. Explores consequences of misunderstanding score reliability. (SLD)

B. Thompson and T. Vacha-Haase have examined the statement "the reliability of the test" with emphasis on the following three words: (1) the first "the"; (2) "test"; and (3) the second "the." This discussion focuses instead on the word "reliability." (Author)

Discusses the fundamental qualities that must be used to judge the merit of performance standards: validity, reliability, and genuineness. The Rasch-based objective model has demonstrated these qualities, but other models should also be evaluated for these characteristics. (SLD)

Presents frequently encountered measurement misconceptions and various measurement "rules." Origins of the misconceptions and rules are described, along with the reasons why they are problematic. Alternate approaches or considerations are given. Misconceptions discussed pertain to the estimation of internal consistency reliability and item…