The present study was conducted to characterize (a) the features of the thousands of primary reports synthesized in 47 reliability generalization (RG) measurement meta-analysis studies and (b) typical methodological practice within the RG literature to date. With respect to the treatment of score reliability in the literature, in an astounding…

The LibQUAL+[TM] protocol solicits open-ended comments from users with regard to library service quality, gathers data on 22 core items, and, at the option of individual libraries, also garners ratings on five items drawn from a pool of more than 100 choices selected by libraries. In this article, the relationship of scores on these locally…

Responds to criticisms of some "Educational and Psychological Measurement" policies and the reliability generalization meta-analytic methods of T. Vacha-Haase. Explores consequences of misunderstanding score reliability. (SLD)

The program evaluation standards approved by the American National Standards Institute (ANSI) in 1994 that deal with reliability and validity accurately represent contemporary views of the psychometric community with regard to reliability and validity. As such, these standards move the field forward. The ANSI standards recognize that reliability…

T. Vacha-Haase (1998) proposed her "reliability generalization" methodology to characterize (a) typical score reliability for a measure across studies, (b) the variability of score reliabilities, and (c) what measurement protocol features predict the variability in score reliabilities across administration. The present article provides…

The reliability and construct validity of scores on the Personal Preferences Self-Description Questionnaire (PPSDQ) (B. Thompson) were studied. Classical psychometric analysis of data from 641 participants (item and alpha analyses and both oblique and orthogonal exploratory factor analyses) indicate that the PPSDQ has reasonable properties. (SLD)

Given the potential value of reliability generalization (RG) studies in the development of cumulative psychometric knowledge, the purpose of this paper is to provide a tutorial on how to conduct such studies and to serve as a guide for researchers wishing to use this methodology. After some brief comments on classical test theory, the paper…

Generalizability theory was used in this study of the Group Embedded Figures Test, which was administered to undergraduates in a mathematics course. Results indicated that the test has desirable psychometric characteristics, including test and item difficulty and item discrimination coefficients. (Author/GDC)

The present study was a psychometric evaluation of two recently revised Jungian personality instruments, the Singer-Loomis Type Deployment Inventory (SL-TDI) and the Personal Preferences Self-Description Questionnaire (PPSDQ). The study also examined the relationship between Jungian personality dimensions and the Five-Factor Model of personality…

Instruments measuring Carl Jung's (1921/1971) theory of psychological types have been widely used in various counseling contexts. The most popular measure of types has been the Myers-Briggs Type Indicator (K. Briggs and I. Myers). This measure has been criticized for dichotomous scoring, forced-choice response formats, and differential gender…

Monte Carlo methods were used to evaluate the degree to which canonical function and structure coefficients may be differentially sensitive to sampling error. For each of 64 research situations, 1,000 random samples were drawn. Both sets of coefficients were roughly equally influenced; some exceptions are noted. (SLD)

Evaluates the psychometric properties of two alternative Jungian personality measures, the Singer-Loomis Type Deployment Inventory and the Personal Preferences Self-Description Questionnaire. Evidence suggests that both the measures of Jungian constructs yielded reasonably reliable and valid scores. Asserts that both measures have potential…

This study applied one-parameter latent trait measurement theory to investigate the measurement characteristics of both forms of a multiple-choice measure of field-independence--the Finding Embedded Figures Test (FEFT). The FEFT has a multiple-choice format that may facilitate administration and scoring in comparison with use of supply-format…

Factor analysis can be a valuable tool for assessing validity; however, the reliabilities of identified factors must be attended to. This study examined the impacts of item variance on factor stability and structure. The attempt was to determine empirically whether unnumbered graphic scales scored using a larger number of scale steps produce more…

Editorial board members of "Educational and Psychological Measurement" were asked to list up to five publications each, written since roughly 1950, that they thought were seminal to shaping the measurement field. This bibliography lists 59 of their selections as a "hit parade" of measurement readings. (SLD)