Item response tree (IRTree) models are a flexible framework to control self-reported trait measurements for response styles. To this end, IRTree models decompose the responses to rating items into sub-decisions, which are assumed to be made on the basis of either the trait being measured or a response style, whereby the effects of such person…

Some aspects of test reliability are discussed. Topics covered are: (1) how high should a reliability coefficient be?; (2) two factors affecting the interpretation of reliability coefficients--range of talent and interval between testings; (3) some common misconceptions--reliability of speed tests, part vs. total reliability, reliability for what…

Ordinal measurement is the rank ordering of individuals in a population. For ordinal measurement, the concept of an individual propensity distribution is his or her true score. Estimation of, as well as other aspects of the distribution, are discussed. (Author/JKS)

A procedure for estimating the reliability of a factorially complex composite is considered. An application of its use with Scholastic Aptitude Test data is provided. (Author/JKS)

Samples in research on individual and group differences may be selected based on whole scores which differ from the population mean. Children are diagnosed in clinical practice with a whole score. These procedures produce regression to the population mean which can affect accuracy and adequacy of part score interpretations. (Author/DWH)

A computer program providing comprehensive test and item analysis is presented. Completing its performance on one run, the program, written in Fortran and emphasizing ease of use, integrates various statistical techniques for analyzing individual items and the overall test, in addition to generating a variety of standard scores. (Author/JKS)

Comparison of the Goodenough-Harris and McCarthy scoring procedures for 60 kindergarten children's drawings yielded substantial agreement between the two scoring systems. The streamlined McCarthy scoring system should be utilized when large numbers of children are being evaluated with short periods of time. (Author)

Item-test correlations are compared to item test-retest correlations as measures for selecting items in test construction. The author concludes that the item test-retest method is superior for item analysis which aims at getting shorter tests while maintaining test stability. (Author/JKS)

An aptitude test requiring 10-minutes' administration time was administered to high school students learning Forkner, Century 21, and Gregg shorthand for the purpose of determining test validity for different shorthand systems. Validity data were obtained from approximately 2000 students. Aptitude test reliability ranged from KR20=0.88 to 0.90.…

When classes are the units of analyses, estimates of the reliability of class means are needed. Using classical test theory it is difficult to treat this problem adequately. Generalizability theory, however, provides a natural framework for dealing with the problem. Each of four possible formulas for the generalizability of class means is derived…

Scores on standardized tests may be expressed in a variety of different modes. Raw scores, grade equivalents, percentile ranks, stanines, and standard scores are the major types in use today. The study investigated whether the mode or scale used to express scores affected the magnitude of group statistics, specifically, t and r (the t-test of the…

An investigation was conducted to determine the effects of response-category weighting and item weighting on reliability and predictive validity. Response-category weighting refers to scoring in which, for each category (including omit and "not read"), a weight is assigned that is proportional to the mean criterion score of examinees selecting…