Develops formulas to cope with the situation in which the reliability of test scores must be approximated even though no examinee has taken the complete instrument. Develops different estimators for part tests that are judged to be classically parallel, tau-equivalent, or congeneric. Proposes standards for differentiating among these three models.…

A formally simple expression for the maximal reliability of a linear composite is provided. Its theoretical implications and its relation to existing results for reliability are discussed. (Author/SLD)

Studied the use of descriptive graphic rating scales by 11 raters to evaluate students' work, exploring different design features. Used a Rasch-model based rating scale analysis to determine that all the continuous scales could be considered to have at least five points, and that defined midpoints did not result in higher student separation…

Discusses assumptions of multiple regression that are not robust to violation: linearity, reliability of measurement, homoscedasticity, and normality. Stresses the importance of checking assumptions. (SLD)

Evaluating a test's reliability often requires dividing it into 3 or more unequal parts, which causes violation of the tau equivalence assumption of Cronbach's alpha. This article presents a criterion for abandoning alpha and an approach for computing a more appropriate estimate of reliability, the Gilmer-Feldt coefficient. (Author)

Reviews the criticisms of sampling assumptions in generalizability theory (and in reliability theory) and examines the feasibility of using representative sampling, stratification, homogeneity assumptions, and replications to address these criticisms. Suggests some general outlines for the conduct of generalizability theory studies. (SLD)

Discusses a method for obtaining point and interval estimates of reliability for composites of measures with a general structure. The approach is based on fitting a correspondingly constrained structural equation model and generalizes earlier covariance structure analysis methods for scale reliability estimation with congeneric tests. (SLD)

Much criticism is leveled at the nature and usefulness of the employment interview. Despite its shortcomings and the availability of more objective means of selection, classification, and placement, the personal interview is used pervasively. A structured interview can increase the reliability and validity of the technique. (JOW)

Examined the reliability and validity of a career commitment measure using employees (N=266) of newspaper and insurance companies. Results showed career commitment could be reliably measured and was operationally distinct from job involvement and organizational commitment. Discusses findings in terms of meaning of career commitment. (Author/ABL)

Cohen's kappa statistic is frequently used to measure agreement between two observers using categorical polytomies. Cohen's statistic is: shown to be inherently multivariate in nature; expanded to analyze ordinal and interval data; and extended to over two observers. A non-asymptotic test of significance is provided for the generalized statistic.…

Gulliksen's matched random subtests method is a graphical method to split a test into parallel test halves, allowing maximization of coefficient alpha as a lower bound to the classical test reliability coefficient. This problem is formulated as a zero-one programing problem solvable by algorithms that already exist. (TJH)

Deals with issues of validity and reliability in qualitative research in education. Discusses philosophical assumptions underlying the concepts of internal validity, reliability, and external validity or generalizability. Presents strategies congruent with a qualitative research perspective for ensuring the rigor and trustworthiness of findings.…

Notes that conventional practice in social work research is to recommend level of reliability close to 0.80 as minimum standard. Contends that needed reliability varies by situation: that in situations in which important decisions about individuals are being made, 0.90 provides better standard; whereas in descriptive survey research with large…

Presents a series of four studies testing the hypothesis that people seek out and prefer information about causal mechanisms rather than information about covariation. Concludes that people attempt to seek out causal mechanisms in developing a causal explanation for a specific event. (DR)

An alternative formula is presented for the reliability of a difference score that contains the correlation between true scores instead of the correlation between observed scores. This approach provides more useful information and yields values that are not as anomalous as those usually obtained. (SLD)