The aim of this study is to compare the results of correlation coefficient estimation of reliability with those obtained through the Bland-Altman plot technique. The scale was first divided into two halves using three different approaches. A linear and high-level relationship was found between the scale scores obtained from the halved forms.…

This paper reports an investigation into the psychometric properties of the COR-Advantage1.5 (COR-Adv1.5) assessment tool, a criterion-referenced observation-based instrument designed to assess the developmental abilities of children from birth through kindergarten. Using data from 8534 children participating in a state-funded preschool program…

Despite the limitations of overgeneralizing cutoff values for confirmatory factor analysis (CFA; e.g., Marsh, Hau, & Wen, 2004), they are still often employed as golden rules for assessing factorial validity in sport and exercise psychology. The purpose of this study was to investigate the appropriateness of using the CFA approach with these…

Item response theory scaling has been well established in achievement testing, but the practice has seen limited use in student development research. The purpose of this study was to explore the reliability and validity of a graded response model scaling of an existing college student satisfaction survey. The existing survey was found to measure…

Psychometric practice does not always converge with the advances of psychometric theory. In order to investigate this gap, the authors focus on the 10 most used psychological tests in Europe, as identified by recent surveys. The article analyzes test manuals published in 6 different European countries for these 10 most used tests. A total of 32…

"Linking" is a term given to a general class of procedures by which one represents scores X on one test or measure in terms of scores Y on another test or measure. A recent taxonomy by Holland and Dorans (2006; Holland, 2007) organizes the various types of links into three broad categories: prediction, scale aligning, and equating. In…

Multitrait-Multimethod analysis and confirmatory factor analysis were used to investigate differences in Likert, Thurstone, and Semantic Differential techniques. Results indicated that these measurement techniques are not completely interchangeable. (JKS)

Unless the characteristics of the units accompanying measurements are known, little legitimate evaluation can occur. Educators cannot assume their measurements are valid bases for evaluative statements unless higher level techniques (such as interval and ratio scales) have been employed. Misinterpretation arises from assuming that measurements…

A logically sound and methodologically easy technique for improving the construct validity of instruments and developed for relatively new concepts is described. It is based on the premise that if an instrument is valid, so should be each item within it and, therefore, the latter should sustain in field setting the behavioral implications derived…

A paired-comparisons study of Patient Management Problem (PMP) test scores was undertaken to investigate the relationship between performance and corresponding scores (proficiency and pathway). Findings suggest that assigning points at the "option level" culminates in scores that cannot readily be linked to behavior they are supposed to…

In this paper, an attempt has been made to synthesize some of the current thinking in the area of criterion-referenced testing as well as to provide the beginning of an integration of theory and method for such testing. Since criterion-referenced testing is viewed from a decision-theoretic point of view, approaches to reliability and validity…

Researchers evaluated the construct validity of attitude measures containing feeling, belief, and intention-to-act components. Evidence strongly suggests that treating these three factors as unidimensional concepts is inadequate for measuring health attitudes--a multidimensional approach is needed. (PP)

An alternative procedure is examined to compare test scores which does not require the utilization of computers and therefore, can be easily employed by classroom teachers. This technique is called the Average System: a simple way to score examinees using information obtained from a representative sample (or samples). Examinees are ranked on a…

Explores the relationship between measurement theory and practice, considering five broad categories of: (1) models, assumptions, and terminology; (2) reliability; (3) validity; (4) scaling; and (5) setting performance standards. It must be recognized that measurement is not an end in itself. (SLD)

In the early twentieth century behaviorist Edward L. Thorndike began the development and use of measurement scales to replace personal judgment to evaluate student compositions in U.S. public schools. In 1912, utilizing the Fullerton and Catell equal difference theorem, Milo B. Hillegas released the first scientifically designed scale to measure…