Compared two Angoff standard-setting methods, percentage, and yes-no, in the work of four groups of judges (n=24) given behavioral descriptors or incidents to use in making ratings. Results indicate that passing scores based on percentage estimates were stable from initial to final ratings, but those based on dichotomous (yes-no) ratings had…

Addresses the lack of congruence between different curricular and evaluation ideologies and the lack of sensitivity regarding underlying theoretical assumptions in curriculum evaluation practices from a perspective that calls for a joint ontological and epistemological view of the curriculum and curriculum evaluation. Explores curriculum as a…

Outlines fundamental reasons why educational research has not provided dependable guidelines for policy, suggesting how to repair what it lacks. Notes that there already exists some reliable research on which to base educational policy, found mainly in cognitive psychology. Asserts that naturalistic and laboratory research in education have a duty…

Presents a model of tests and measurement that identifies test scores with Hilbert space vectors and true and error components of scores with linear operators. This geometric point of view brings to light relations among elementary concepts in test theory, including reliability, validity, and parallel tests. (Author/SLD)

Conducted a reliability generalization study of the Geriatric Depression Scale (T. Brink and others, 1982). Results from this investigation of 338 studies shows that the average score reliability across studies was 0.8482 and identifies the most important predictors of score reliability. (SLD)

From a six-state sample of 286 bank tellers and supervisors, 118 returned an assessment of a DACUM-generated task listing for the teller occupation. Results indicated that the task listing was highly reliable and possessed substantial construct validity, although tasks added by respondents may indicate that DACUM is not yet a stand-alone…

Reference-reliability relates variability due to change and error. It indicates whether some suspected change can be reliably differentiated from random fluctuations. A means by which the process of change can be measured at different points in time is outlined, using empirical data. (TJH)

An approximate statistical test of the equality of two intraclass reliability coefficients based on the same sample of people is derived. Such a test is needed when a researcher wishes to compare the reliability of two measurement procedures, and both procedures can be applied to results from the same group. (SLD)

Describes ways in which content analysis is being used in library and information science research. Methodological concerns are addressed, including selection of target documents, selection of samples to be analyzed, selection of categories for analysis, and elimination of researcher bias to assure reliability. (35 references) (LRW)

Claims that portfolios can be reliably rated in a large-scale assessment situation. Shares the experiences of writing program administrators concerning portfolio assessment. Outlines practical methods of gaining reasonable reliability in portfolio scoring. (RS)

Treatment manuals and protocols have made delivery of particular therapies purer and more consistent, initiating a demand that researchers not only use treatment manuals to improve purity of their therapy but document that their efforts to achieve purity have been successful. Strategies that have been used to document treatment integrity are…

Examines mechanisms underlying the misinformation effect, in which children can be made to believe that they have seen or experienced something they never have. Suggests that the effect in younger children is mainly due to memory errors, whereas in older children it is mainly due to acceptance of misleading information. (DSK)

Investigated the effects of types and prevalence of response patterns that might be provided by nonattending respondents on Cronbach's alpha (L. Cronbach, 1970) using three simulated data sets. Effects were greater as a function of increased prevalence in the respondent group, but as few as 5% of some types of nonattending patterns had inflating…

Exploratory factor analysis of data from 564 people identified constructs for the Career Influence Inventory: parent/teacher/friend influence, high school academic experience, negative social events, self-efficacy, and ethnic-gender expectations. Negative social events proved to be an emerging construct for understanding career development and…

This study aimed to develop and validate an instrument to be used by teachers to measure the frequency of behaviors indicative of self-esteem and then to evaluate the instruments' reliability and concurrent validity. The Behavioral Indicators of Self-Esteem Scale proved to be reliable and a valid measure. (Author)