A systemic view of training and development emphasizes art and science touched with creativity. In such a view, media are central to the concept of human reliability, and should be specifically designed to enhance communication. (SK)

Understanding the nature of science, especially how scientists err, is an essential tool for: (1) assessing the reliability and scope of scientific claims; (2) perceiving the scope of these claims; and (3) making personal and public decisions. What features of the nature of the science are most important to know? Recent consensus highlights the…

This paper describes procedures for estimating various indices of classification consistency and accuracy for multiple category classifications using data from a single test administration. The estimates of the classification consistency and accuracy indices are compared under three different psychometric models: the two-parameter beta binomial,…

The purposes of this paper are to identify common errors made by researchers when dealing with reliability coefficients and to outline best practices for reporting and interpreting reliability coefficients. Common errors that researchers make are: (1) stating that the instruments are reliable; (2) incorrectly interpreting correlation coefficients;…

Testing programs that report a single score based on multiple choice and performance components must face the issue of how to derive the component scores. This paper identifies and logically evaluates alternative component weighting methods. It then examines composite reliability and validity as a function of weights, component reliability,…

This paper reviews issues involved in converting continuous variables to nominal variables to be used in the OVA techniques. The literature dealing with the dangers of dichotomizing continuous variables is reviewed. First, the assumptions invoked by OVA analyses are reviewed in addition to concerns regarding the loss of variance and a reduction in…

The stabilities of standardized (ß) and structure (rs) coefficients in canonical (CA) and discriminant analyses (DA) were studied. Four different situations were studied--two pertaining to CA and two to DA. The situations were meant to represent "somewhat typical" and yet varying research conditions that often would not be thought to be…

The major goal of this paper was to provide a definition and measure of profile reliability and considered the problem of constructing reliable profile dimensions. (Author/RK)

A study, providing an alternative to traditional closure systems of measurement, explores the reliability and use of carefully anchored rating scales to establish rehabilitation clients' physical, educational, and psychosocial functioning and, thus, assess client status or change. (EA)

The specific purpose of the present study was to evaluate the Hostility and Direction of Hostility Questionnaire (HDHQ) developed by Caine, Foulds, and Hope (1967) with a view to enhancing discriminant validity and suppressing the effects of desirability responding." (Author)

The peer review process used to select manuscripts for publication in academic journals is important to the individual researcher and the scientific community, but it has been the topic of little research. This article analyzes the reviewers overall recommendation, ratings on specific subscales, and written critiques. Reviewer reliability is…

Investigated whether facial expressions are reliable in producing the same emotional responses from infants (N=27) across situations designed to elicit the same emotion and whether they provide sufficient information to mediate consistent emotion judgments by raters. (JMB)

A computer program entitled Program CONGRU is presented which analyzes the overall conjoint agreement among many observers for their classifications on categorical scales. A special feature assesses the significance of observers' congruence in assignments to each nominal category considered. (Author)

The evaluation of the 1984-95 occupational employment projections can determine the reliability of information based on the Bureau of Labor Statistics (BLS) track record and enable BLS to improve the accuracy of its subsequent projections. (JOW)