Reliability of screening for selection for postgraduate training was assessed by correlating ratings by four readers of the application papers, showing also that the selection of preferred candidates from the total interviewed did not differ from change. (Author/KM)

The study investigated the feasibility of adapting the coefficient k introduced by Cohen (1960) and elaborated by Swaminathan, Hambleton, and Algina (1974) to an internal consistency estimate for criterion referenced tests in single test administrations. The authors proposed the use of k as an internal consistency estimate by logically dividing…

Single-administration procedures for estimating the coefficient of agreement, a reliability index for criterion referenced tests, were recently developed by Subkoviak. The procedures require a distributional assumption for errors of measurement and an estimate of each examinee's true score. A computer simulation of tests composed of items that…

The problem of demonstrating replicability of factor structure across random variables is addressed. Procedures are outlined which combine the use of random subsample replication strategies with the correlations between factor score estimates across replicate pairs to generate a coefficient of replicability and confidence intervals associated with…

Results showed that the canonical correlations are very stable upon replication. The results also indicated that there is no solid evidence for concluding that components are superior to the coefficients, at least not in terms of being more reliable. (Author/BJG)

Estimates for the variances of empirically determined scoring weights are given. It is also shown that test item writers should write distractors that discriminate on the criterion variable when this type of scoring is used. (Author)

The professional orientation difference approach was operationalized as a stress on the importance of intellectual activity, autonomy, service and influence, with de-emphasis on the monetary, prestige, security and human relations aspects of a job. As a difference score, the index was subject to special reliability problems. This analysis…

The purpose of this study was to present an empirical correction of the KR21 (Kuder Richardson test reliability) formula that not only yields a closer approximation to the numerical value of the KR20 without overestimation, but also simplifies computation. This correction was accomplished by introducing several correction factors to the numerator…

The manual attempts to give definitive, illustrative guidelines for standardizing task statements according to the principles and techniques of Functional Job Analysis (FJA). It is therefore intended for use by persons trained and competent in FJA task analysis. Section 2 briefly reviews some of the concepts and assumptions which are involved in…

The Cranfield Project was done in a laboratory sphere. In a practical situation, it is impossible to determine how many documents are relevant to a certain question. Although in the Cranfield Project collections of different sizes have been used, these collections do not fulfill the requirements that the small collections are randomly taken from…

A study was designed to determine whether the presence or absence of a classroom observer and the prior knowledge or lack of knowledge that an observation was to occur would affect the verbal behavior of teachers as measured by the Flanders System of Interaction Analysis. The variables were dichotomized yielding a 2 x 2 x 2 experimental design…