Investigated the interscorer reliability between a novice and a professional psychologist for the Minnesota Percepto-Diagnostic Test-Revised (MPDT-R), using a sample of 30 individuals. Results indicated that for three of the four MPDT-R scores there was a significant positive correlation between expert and novice scoring criteria. (JAC)

Profile stability of the Kuder Occupational Interest Survey was assessed for profiles obtained twelve and nineteen years apart for persons between thirteen and twenty years of age at the time of first administration. Reported reliabilities ranged from .40 to .80 for various sub-samples. (JKS)

States that, due to confusion of concepts and lack of systemization, "previous studies are often difficult to interpret and consequently...afford little possibility of formulating more precise statements about those errors the concepts represent...." A proposal for systematization is presented. (Author/RW)

The author discusses his reaction to the CIRCUS test. (RC)

Fleiss' popular multirater kappa is known to be influenced by prevalence and bias, which can lead to the paradox of high agreement but low kappa. It also assumes that raters are restricted in how they can distribute cases across categories, which is not a typical feature of many agreement studies. In this article, a free-marginal, multirater…

The purpose of this study was to assess the reliability of the General Dissociation Scale with African American college students, and provide additional data on how to assess hypnotizability with these students. Two-hundred and two undergraduate African American college students participated in this study. Students completed the HGSHS:A, a measure…

D. Wood and J. Erskine (1976) and B. Thompson (1989) provided bibliographies of roughly 130 applications of canonical correlation analysis, but the features of such reports have not been widely studied. This report examines the features of recent canonical reports, including substantive inquiries, but also measurement applications examining…

This study examined the reliability of three methods for detecting differential item functioning (DIF) (i.e., the Mantel-Haenszel method, the standardization method, and the logistic regression method) applied to achievement test data. In addition, the study examined the influences of different sources of error variance, including examinee,…

This study was concerned with ranking items with Likert scale data when the items are subject to systematic (nonrandom) patterns of nonresponse. Researchers applied the rating scale model of D. Andrich (1978) to data from a survey in which the item response rate varied from less than 1% to over 90%. Data were from a section of the Student Opinion…

The Mathematics Anxiety Rating Scale (MARS) (F. Richardson and R. Suinn, 1972) was submitted to a reliability generalization analysis to characterize the variability of measurement error in MARS scores across administrations and to identify possible study characteristics that are predictive of reliability variation. The meta-analysis was performed…

The literature on measurement reliability shows the consensus that group heterogeneity with regard to the trait being measured is a factor that affects the sample measurement reliability, but the degree of such effect is not entirely clear. Sample performance also has the potential to affect measurement reliability because of its effect on the…

This test-retest reliability study was conducted to test the reliability of an instrument designed to measure the relative importance of eight implementation conditions. Data for the Ensminger-Surry Implementation Profile Instrument (ESIP) were gathered starting January 2003. Participants were from a variety of occupations. Ages ranged from the…

A matrix of characteristics associated with transformational leadership and with high reliability organizations was developed. Using the matrix as a lens, researchers examined a successful school involved in a school improvement effort to understand the success more fully. Transformational leaders provide opportunities for personal growth for…

Where the accuracy of a measurement is important, whether for scientific or practical purposes, the investigator should evaluate how much random error affects the measurement. New research may not be necessary when a procedure has been studied enough to establish how much error it involves. But, with new measures, or measures being transferred…

This study attempts to determine the extent of agreement on the Torrance Tests of Creative Thinking scores among independent scorers with no training other than individual study of the scoring guides, and a scorer trained by Torrance. (Author)