A latent variable modeling approach for scale reliability evaluation in heterogeneous populations is discussed. The method can be used for point and interval estimation of reliability of multicomponent measuring instruments in populations representing mixtures of an unknown number of latent classes or subpopulations. The procedure is helpful also…

Certain diversity among team members is beneficial to the growth of an organization. Multiple measures have been proposed to quantify diversity, although little is known about their psychometric properties. This article proposes several methods to evaluate the unidimensionality and reliability of three measures of diversity. To approximate the…

Many measurement biases affect student evaluations of instruction (SEIs). However, two have been relatively understudied: halo effects and ceiling/floor effects. This study examined these effects in two ways. To examine the halo effect, using a videotaped lecture, we manipulated specific teacher behaviors to be "good" or "bad"…

The primary aim of this study was to examine the psychometric properties of the scores on a version for children of the Carver and White Behavioral Inhibition and Activation scales (the BIS-BAS scales). This involved administering the BIS-BAS scales, the Positive and Negative Affect Schedule, the Junior Eysenck Personality Questionnaire…

Recommendations are made for the appropriate use and identification of traditional Kuder-Richardson formulas for the estimation of reliability. "Alpha" should be used for reliabilities estimated for tests or scales composed of items yielding scores distributed on more than two points. (SLD)

Anxiety is one of the most pervasive symptoms seen in clinical psychological disorders. The Beck Anxiety Inventory (BAI) is a popular measure to assess the construct of anxiety. This study was concerned with an examination of potential study factors that are associated with the variability of the reliability estimates of the BAI scores. A review…

Variance components from split-plot factorial design (SPF) were used to estimate reliability for schools and persons within schools. Reliability for persons within SPF and randomized block design (RB) schools were compared and reliability for SPF and RB design schools were compared. (Author/BJG)

Two new prophecy formulas for estimating item response theory (IRT)-based reliability of a shortened or lengthened test are proposed. Some of the relationships between the two formulas, one of which is identical to the well-known Spearman-Brown prophecy formula, are examined and illustrated. The major assumptions underlying these formulas are…

The generalizability of student evaluations of college instruction is analyzed and generalizability theory data collected in a common design is applied. Results suggest that use of student evaluations of teacher effectiveness may lead to decisions based upon undependable data. (Author/GK)

A reliability generalization of the Revised Children's Manifest Anxiety Scale (RCMAS) was conducted using the normative sample. The RCMAS consists of a Total Anxiety scale as well as four subscales. Results suggest that the Total Anxiety scores are typically reliable (median across 48 samples = .81). Subscale scores were less reliable: The median…

This article reports three studies in which a scale for assessing teachers' beliefs about professional-development initiatives was developed and its scores evaluated for reliability and validity. Results indicated that the Teachers' Attitudes About Professional Development (TAP) scale produced scores with high reliability, a stable one-factor…

The present study proposes a teaching satisfaction measure and examines the validity of its scores. The measure is based on the Life Satisfaction Scale (LSS). Scores on the five-item Teaching Satisfaction Scale (TSS) were validated on a sample of 202 primary and secondary school teachers and favorable psychometric properties were found. As…

Technical characteristics of Slosson Phonics and Structural Analysis Test (SP-SAT) scores were studied using three independent samples of boys and girls aged 6 years, 6 months, through 9 years, 11 months. A decision efficiency study (n = 100) resulted in a total predictive value of .86 (sensitivity = .95, specificity = .77, positive predictive…