Studied three measures of task and ego achievement goal orientations in terms of factorial and construct validity, internal consistency reliability, and distributional characteristics. Results for 393 undergraduates suggest that the Patterns of Adaptive Learning Survey scales fared better than the other 2 in terms of distributional…

Describes a process directed at developing a simple paper-and-pencil checklist to assess Intranet effectiveness. Discusses the checklist purification procedure, and attempts to establish reliability and validity for the list. Concludes by identifying managerial applications of the checklist, recognizing the limitations of the approach, and…

Examined the best approach to the development of procedures for assessing beginning teachers, reviewing studies on teacher thinking, development, learning, and knowledge; examining studies on new approaches to teacher evaluation and on issues of validity and reliability; and proposing a framework with 15 implications for the development of…

Demonstrates empirically a structural equation modeling technique for group comparison of reliability and validity. Data, which are from a study of 495 mothers' attitudes toward pregnancy, have a one-factor measurement model and three sets of subpopulation comparisons. (SLD)

Presents a generalizability theory (GT) analysis of data from 531 agricultural students' evaluations of teaching. Illustrates GT estimations of reliability for student and class means and the use of GT in obtaining standard errors. (SK)

Constructed a multiple choice instrument to assess the level of competence of students aged 15 and 16 on eight cross-curricular skills. A pilot study involving 465 students and a main study with 9,000 students supported the developed measure, the Cross-Curriculum Skills Test, as a valid and reliable test of cross-curricular skills. (SLD)

Examined the effects of test length and sample size on the alternate forms reliability and equating of simulated mathematics tests composed of constructed response items scaled using the two-parameter partial credit model. Results suggest that, to obtain acceptable reliabilities and accurate equated scores, tests should have at least 8 6-point…

Examined whether preschool children's play-partner choices were stable over time and how they influenced behavior. Found that partner preferences were highly sex differentiated and stable over time. Identified two types of consequences of partner choice: a binary effect that influenced differences between the sexes and a social dosage effect that…

This study investigated children's sensitivity to spelling consistency, and lexical and sublexical (rime) frequency, and their use of explicitly learned canonical vowel graphemes in the early stages of learning to spell. Vowel spellings produced by 78 British children at the end of reception year (mean age 5 years, 7 months) and 6 months later in…

This article discusses PC reliability, one of the most pressing issues regarding computers. Nearly a quarter century after the introduction of the first IBM PC and the outset of the personal computer revolution, PCs have largely become commodities, with little differentiating one brand from another in terms of capability and performance. Most of…

Experiments offer more reliable evidence on causation than observational studies, which is not to gainsay the contribution to knowledge from observation. Experiments should be analyzed as experiments, not as observational studies. A simple comparison of rates might be just the right tool, with little value added by "sophisticated" models. This…

The second preclinical year of the medical curriculum at the Medical Faculty of the University of Lausanne in Switzerland includes nine multidisciplinary organ-system-oriented modules consisting of lectures and problem-based-learning tutorials. This study reports the experience accumulated with the evaluation of lectures during the academic years…

As public policies increasingly hold schools responsible for preventing school failure, experiences of other organizations that must operate with high reliability may be helpful. This article builds on previous studies of high reliability organizations to inquire how their strategies might inform efforts to improve reliability in loosely coupled…

This article describes an activity through which students collect data and explore ways to display them through graphs and charts. It also motivates various summary measures for location, spread and shape. Finally, it gives an introduction to concepts of validity, reliability and unbiasedness.

In this article, the authors (a) illustrate how displaying disattenuated correlation coefficients alongside their unadjusted counterparts will allow researchers to assess the impact of unreliability on bivariate relationships and (b) demonstrate how a proposed new "what if reliability" analysis can complement null hypothesis significance…