This study investigated children's sensitivity to spelling consistency, and lexical and sublexical (rime) frequency, and their use of explicitly learned canonical vowel graphemes in the early stages of learning to spell. Vowel spellings produced by 78 British children at the end of reception year (mean age 5 years, 7 months) and 6 months later in…

This article discusses PC reliability, one of the most pressing issues regarding computers. Nearly a quarter century after the introduction of the first IBM PC and the outset of the personal computer revolution, PCs have largely become commodities, with little differentiating one brand from another in terms of capability and performance. Most of…

Sensitivity theory proposes that there are wide individual differences in what motivates people with intellectual disability. The Reiss Profile MRDD is a rating scale that measures 15 fundamental motives. This study examined the internal consistency and interrater reliability of the 15 subscales as well as the validity of motivational profiles.…

Although instructional methods are moving in ever greater number to a multimedia base, testing is not. What principles should be considered in correcting this misalignment?

Experiments offer more reliable evidence on causation than observational studies, which is not to gainsay the contribution to knowledge from observation. Experiments should be analyzed as experiments, not as observational studies. A simple comparison of rates might be just the right tool, with little value added by "sophisticated" models. This…

The second preclinical year of the medical curriculum at the Medical Faculty of the University of Lausanne in Switzerland includes nine multidisciplinary organ-system-oriented modules consisting of lectures and problem-based-learning tutorials. This study reports the experience accumulated with the evaluation of lectures during the academic years…

Kowalski and Zimiles (2006) and O'Hanlon and Roberson (2006) address an age-old question: Why do children find it difficult to learn color terms? Here these articles are reflected on, providing a focused examination of the issues central to this question. First, the criteria by which children are said to find color naming difficult are considered.…

Psychometric theory focuses primarily on tests that are homogeneous, measuring only one attribute of a psychosocial entity. However, the complexity of psychosocial behavior often requires tests that are heterogeneous, measuring more than one attribute. In this presentation, reliability and internal consistency are extended to heterogeneous tests…

A self-report inventory for the assessment of mindfulness skills was developed, and its psychometric characteristics and relationships with other constructs were examined. Participants included three samples of undergraduate students and a sample of outpatients with borderline personality disorder. Based on discussions of mindfulness in the…

As public policies increasingly hold schools responsible for preventing school failure, experiences of other organizations that must operate with high reliability may be helpful. This article builds on previous studies of high reliability organizations to inquire how their strategies might inform efforts to improve reliability in loosely coupled…

This article describes an activity through which students collect data and explore ways to display them through graphs and charts. It also motivates various summary measures for location, spread and shape. Finally, it gives an introduction to concepts of validity, reliability and unbiasedness.

A reliability generalization of the Revised Children's Manifest Anxiety Scale (RCMAS) was conducted using the normative sample. The RCMAS consists of a Total Anxiety scale as well as four subscales. Results suggest that the Total Anxiety scores are typically reliable (median across 48 samples = .81). Subscale scores were less reliable: The median…

In this article, the authors (a) illustrate how displaying disattenuated correlation coefficients alongside their unadjusted counterparts will allow researchers to assess the impact of unreliability on bivariate relationships and (b) demonstrate how a proposed new "what if reliability" analysis can complement null hypothesis significance…

The fields of language testing and educational and psychological measurement have not, as yet, developed a set of principles and procedures for linking test scores and score-based inferences to test use and the consequences of test use. Although Messick (1989) discusses test use and consequences, his framework provides virtually no guidance on how…

In this article, we report on our qualitative study involving eight individuals hired to transcribe research tapes in university contexts. We consider issues of data analysis and data trustworthiness and the implications for both when transcription is assigned to someone other than the researcher. We explore the challenges transcribers faced…