Studied the use of descriptive graphic rating scales by 11 raters to evaluate students' work, exploring different design features. Used a Rasch-model based rating scale analysis to determine that all the continuous scales could be considered to have at least five points, and that defined midpoints did not result in higher student separation…

Discusses assumptions of multiple regression that are not robust to violation: linearity, reliability of measurement, homoscedasticity, and normality. Stresses the importance of checking assumptions. (SLD)

Reviews the criticisms of sampling assumptions in generalizability theory (and in reliability theory) and examines the feasibility of using representative sampling, stratification, homogeneity assumptions, and replications to address these criticisms. Suggests some general outlines for the conduct of generalizability theory studies. (SLD)

Discusses a method for obtaining point and interval estimates of reliability for composites of measures with a general structure. The approach is based on fitting a correspondingly constrained structural equation model and generalizes earlier covariance structure analysis methods for scale reliability estimation with congeneric tests. (SLD)

Much criticism is leveled at the nature and usefulness of the employment interview. Despite its shortcomings and the availability of more objective means of selection, classification, and placement, the personal interview is used pervasively. A structured interview can increase the reliability and validity of the technique. (JOW)

Deals with issues of validity and reliability in qualitative research in education. Discusses philosophical assumptions underlying the concepts of internal validity, reliability, and external validity or generalizability. Presents strategies congruent with a qualitative research perspective for ensuring the rigor and trustworthiness of findings.…

Notes that conventional practice in social work research is to recommend level of reliability close to 0.80 as minimum standard. Contends that needed reliability varies by situation: that in situations in which important decisions about individuals are being made, 0.90 provides better standard; whereas in descriptive survey research with large…

Presents a series of four studies testing the hypothesis that people seek out and prefer information about causal mechanisms rather than information about covariation. Concludes that people attempt to seek out causal mechanisms in developing a causal explanation for a specific event. (DR)

An alternative formula is presented for the reliability of a difference score that contains the correlation between true scores instead of the correlation between observed scores. This approach provides more useful information and yields values that are not as anomalous as those usually obtained. (SLD)

Identifies and evaluates alternative methods for weighting tests. Presents formulas for composite reliability and validity as a function of component weights and suggests a rational process that identifies and considers trade-offs in determining weights. Discusses drawbacks to implicit weighting and explicit weighting and the difficulty of…

Investigated how dissimilar in composition and variability samples inducting reliability coefficients from prior studies were from the cited prior samples from which coefficients were generalized. Results from 20 articles show that citing reliability coefficients from prior studies as the basis for concluding new scores are reliable is only…

Describes the development of the Moral Justification Scale, an objective measure of justice and care orientations. The scale was administered to 100 college students. Results imply that the Moral Justification Scale shows promise as an easily administered, objectively scored measure of Giligan's constructs of care and justice. (Author/MKA)

The population discrepancy between Cronbach's Coefficient Alpha (L. Cronbach, 1951) and scale reliability with fixed congeneric measure, uncorrelated errors, and sampling of subjects was studied. The difference is expressed in terms of the individual component violations of the assumption of equal tau-equivalence that is necessary and sufficient…

A number of school-based programs address sexual violence by focusing on adolescents' attitudes about rape or acceptance of rape myths. However, really problems exist in the literature regarding measurement of rape myth acceptance, including issues of reliability and validity. This paper addresses measurement reliability issues and reviews…

A covariance structure modeling perspective on reliability estimation can be used to construct a formal approach to estimation of reliability in multilevel models. This article presents a didactic discussion of the relation between a structural modeling procedure for scale reliability estimation and the notion of reliability of observed means in…