It is shown that the Angoff and bookmarking cut scores are examples of true score equating that in the real world must be applied to observed scores. In the context of defining minimal competency, the percentage "failed" by such methods is a function of the length of the measuring instrument. It is argued that this length is largely…

Background: Persons with intellectual disabilities (ID) are at increased risk for hearing impairment which often remains undetected. If left untreated, such hearing impairments may worsen the social and communicative problems of these persons. The aims of this study are to determine the prevalence of hearing impairment, to specify type and degree…

Although practiced widely in management education, grading of student participation in class discussions has been criticized by researchers: The instructor simultaneously adopts two incompatible tasks of facilitating class discussion and evaluating student participation; students play for points instead of focusing on learning; and common,…

Comparisons were made among various methods of estimating the reliability of pass-fail decisions based on mastery tests. The reliability indices that are considered are p, the proportion of agreements between two estimates, and kappa, the proportion of agreements corrected for chance. Estimates of these two indices were made on the basis of…

There are few existing or widely known measures of agreement applicable when data is nominal or categorical. Most such coefficients are applicable only when judges classify objects or subjects into a single category. A wider range of applications, including those where judges (1) place probabilities on subjects belonging to mutually exclusive and…

This paper brings together a variety of item-analysis techniques into a coherent system. The system is based on classical test theory, the theorems that can be derived from the equation, X = T + E. The system extends from techniques for analyzing parts of an item separately to techniques for relating items to total test score, to sub-scores, to…

Total circular triad scores (TCT) derived from the pair-comparison Minnesota Importance Questionnaire (MIQ) were used to study the relationship between inconsistency, and both internal consistency reliability and stability. Stability estimates (and Hoyt Coefficients) were computed for each of nine groups (retest internals from immediate retest to…

A major problem in the research concerning distributional and other properties of reliability coefficients has been the non-existence or inaccessibility of adequate test data for use in empirical verification of hypothetical conclusions. The purpose of this paper is to develop a technique for the simulation of test item scores through the use of…

Section 3 of Phase II of the Pennsylvania Plan is concerned with the adequacy of the educational quality assessment instruments. An overall discussion of reliability--content, criterion related, and construct--is presented. Reliability coefficients for the assessment inventories are provided and empirical studies of validity are described. (PR)

Procedures are described which were used to develop an instrument and scale to measure an individual's ability to detect and describe the immediate affective state of another. Data are presented indicating the scale's reliability and the extent of the scale's content, concurrent, and predictive validity. (Author)

Interviewed Israeli students to assess the Adult Attachment Interview's test-retest reliability and effects of the interviewers on the interview itself. Information about subjects' memory and intellectual abilities was obtained from external sources. Found a high degree of interrater and test-retest reliabilities, irrespective of interviewers.…

The Neurobehavioral Assessment of the Preterm Infant instrument was developed by means of pilot, exploratory, and validation studies. The validation study tested the generalizability of results for different cohorts, test versions, hospitals, and examiners. Seven stable functions were identified: motor development; scarf sign; popliteal angle;…

The third edition of the "Boston Diagnostic Aphasia Examination" (Goodglass, Kaplan, and Barresi) introduced standardized procedures for coding discourse samples elicited using the well known Cookie Theft illustration. To evaluate the reliability of this discourse coding procedure, a transcribed sample was coded by 14 novice examiners…

Followership, being an understudied concept, raises fundamental questions: How did followership develop? Why do people submit into becoming followers? The developmental trajectory for the development of individual attributes is as yet, uncharted. Current study provides an overview of assessed attributes of followers, as proposed by Antelo (2010).…

This article draws from a research project in 2007 with a small group of New Zealand outdoor educators. The purpose of the project was to examine teacher beliefs about outdoor education and explore the complex relationships between beliefs, values, and self-perceptions of pedagogical practice. Of specific interest was how theories of consistency…