This paper continues an exchange between its author and Andrew Davis. Part I addresses the attribution and ontological status of mental constructs and argues that philosophical work on these topics does not undermine high stakes testing. Part II examines the significance for testing of the connectedness of meaningful learning. Part III addresses…

Two methods of assessing preference for stimuli (i.e., potential reinforcers) were compared for adult administrative assistant employees. During Phase 1, a survey method and a verbal choice method of assessing preference for 6 stimuli were administered. During Phase 2, a coupon system was used to determine which categories of stimuli actually…

A structural equation modeling approach to scale reliability evaluation can be employed to estimate generalizability theory indexes in settings where sampling of subjects and conditions is carried out. In one- and two-facet crossed designs, it is demonstrated how this method can be used to obtain estimates of relative generalizability…

Seven approaches to averaging reliability coefficients are presented. Each approach starts with a unique definition of the concept of "average," and no approach is more correct than the others. Six of the approaches are applicable to internal consistency coefficients. The seventh approach is specific to alternate-forms coefficients. Although the…

The metric equivalence of translated scales is often in question but seldom examined. This study presents test-retest data that support the metric equivalence of the Spanish and English language versions of three measures: the Bidimensional Acculturation Scale, the Satisfaction with Life Scale, and the Self-Construal Scale. Participants were…

Comments on the response offered by Cheng and Novick to White's initial comments on Cheng's and Cheng and Novick's previous articles. White asks if regularity information necessary for causal learning. He and Cheng and Novick agree that the causal relation is understood as a generative relation, but disagree on how this understanding comes about.…

This study examined the test-retest reliability and the concurrent validity of the 17-scale Expanded Skills Confidence Inventory in samples of 321 and 175 college students. Retest values over a 3-week interval ranged from .77 to .89, with a median of .85. Using Brown and Gore's C-index, evidence for the concurrent validity of confidence score…

Test reliability is a concept central to classical test theory and it is commonly stated as a requirement that a test attain a certain level of reliability before it be considered of sufficient quality for practical use. This article discusses the role of reliability in item response theory, and in particular the role of reliability in contexts…

Direct observation plays an important role in the assessment practices of school psychologists and in the development of evidence-based practices in general and special education. The defining psychometric features of direct observation are presented, the contributions to assessment practice reviewed, and a specific proposal is offered for…

Transcript analysis is an important methodology to study asynchronous online educational discourse. The purpose of this study is to revisit reliability and validity issues associated with transcript analysis. The goal is to provide researchers with guidance in coding transcripts. For validity reasons, it is suggested that the first step is to…

Purpose: To provide educationalists with an understanding of the key quality issues relating to multiple-choice tests, and a set of guidelines for the quality assurance of such tests. Design/methodology/approach: The discussion of quality issues is structured to reflect the order in which those issues naturally arise. It covers the design of…

A study was conducted to assess the equivalence of validity and reliability of two forms of the Self-Esteem Rating Scale. A total of 228 responses were obtained from a purposive sample. Several data analysis methods were used to test specific hypotheses, and two methods of equating observed scores on the two forms were used. The results were…

Within the field of psychological assessment, the Wechsler scales continue to be the most widely used intelligence batteries. The concepts, methods, and procedures inherent in the design of the Wechsler scales have been so influential that they have guided most of the test development and research in the field for more than a half century. This…

This article offers an overview of learning styles theories, selects seven to consider in more detail on the basis of recent research into validity and reliability, and synthesises these theories into a framework to aid task design in Teacher Education.

The reliability of a laser system was compared with the reliability of a video-based kinematic analysis in measuring displacement and velocity during running. Validity and reliability of the laser on static measures was also assessed at distances between 10 m and 70 m by evaluating the coefficient of variation and intraclass correlation…