Cason and Cason's model of performance rating was used to determine the extent to which variation in reviewer standards affected the reliability and validity of the program review process used to select papers for inclusion in the annual program. Data analyzed were the overall recommendation for acceptance and ratings on seven quality criteria…

Generalizability theory, which subsumes classical measurement theory as a special case, provides a general model for estimating the reliability of observational rating data by estimating the variance components of the measurement design. Research data from the "Heart Smart" health intervention program were analyzed as a heuristic tool.…

A large number of seemingly diverse coefficients have been proposed as indices of dependability, or reliability, for domain-referenced and/or mastery tests. In this paper, it is shown that most of these indices are special cases of two generalized indices of agreement: one that is corrected for chance, and one that is not. The special cases of…

Replicated and extended American research on overt and relational aggression with Italian children. Found that peer and teacher nominations for aggression and prosocial behavior were highly stable, although with very poor concordance between them. Peer nominations for overt and relational aggression were linked to peer rejection. Boys' scores were…

Examined item-level and test-level characteristics for items in a high-stakes school-leaving mathematics examination. Results from 158 students show that the influence of testwiseness is lessened when three-option items are used. Tests of three-option items are at least equivalent to four-option item tests in terms of internal-consistency score…

Research has shown that performance on the "Assessment of Basic Learning Abilities" (ABLA) test correlates with language assessments for persons with developmental disabilities. This study investigated whether performance on ABLA Level 6, an auditory-visual discrimination, predicts performance on a receptive language task with persons with severe…

Background: Psychology and educational theory has a long tradition of research into learning styles. However, the current educational policy and practice interest in learning styles in the UK has resulted in concepts and practices being adopted with little rigorous empirical evaluation. Purpose: This small-scale, experimental study aimed to test…

The nature and severity of dynamic risk factors among a group of 87 adult male sexual abusers with intellectual disabilities were examined as was the psychometric properties of a new scale designed to measure these risk factors. The Treatment Intervention and Progress Scale for Sexual Abusers with Intellectual Disabilities (TIPS-ID) is composed of…

The focus of this article is the reliability of content analysis of students' computer conference communication. Content analysis is often used when researching the relationship between learning and the use of information and communications technology in educational settings. A number of studies where content analysis is used and classification…

The Ways of Mattering questionnaire (N. E. Amundson, 1993, 2003) was developed to evaluate clients' perceptions of a counseling relationship. This study reports the construct and convergent validities of the Ways of Mattering as well as the internal consistency of each of its subscales for people with mental illness who were registered in…

Essay marking is a subjective intellectual exercise in which the score reliability can be influenced by many factors such as the test design, the marker's interpretation of the marking criteria, the procedure, and the method used in the marking process. After conducting a literature review this study investigated the reliability of essay marking…

This "Monograph" reports theoretically relevant behavioral, biological, and self-report assessments of a sample of 14-17-year-olds who had been classified into one of four temperamental groups at 4 months of age. The infant temperamental categories were based on observed behavior to a battery of unfamiliar stimuli. The infants classified as high…

Because of the increased popularity of computerized adaptive testing (CAT), many admissions tests, as well as certification and licensure examinations, have been transformed from their paper-and-pencil versions to computerized adaptive versions. A major difference between paper-and-pencil tests and CAT from an examinee's point of view is that in…

There is considerable confusion in the media and the public about healthy behaviors in contrast to "antiaging" behaviors designed to make one look "younger." As an aid in clarifying the differences between these two types of behaviors, we have developed a questionnaire called the Health Behavior Inventory (HBI). We also wanted to estimate…

To date, published studies regarding the Things I Worry About Scale have been conducted exclusively in Northern Ireland and have included relatively homogeneous samples of students. The present study reexamined the psychometric properties of the scale using data collected from a sample of at-risk adolescents in the United States. The factor…