Structural invariance of self-rated satisfaction with life data was assessed using four data sets collected in earlier studies by using the Satisfaction With Life Scale. Three measurement models were compared to account for structural variability of the data. Strict structural invariance was rejected. Departure from the one-factor model was only…

The asymptotic standard deviation (SD) of the alpha coefficient with standardized variables is derived under normality. The research shows that the SD of the standardized alpha coefficient becomes smaller as the number of examinees and/or items increase. Furthermore, this research shows that the degree of the dependence of the SD on the number of…

A method for estimation of reliability for multiple-component measuring instruments with clustered data is outlined. The approach is applicable with hierarchical designs where individuals are nested within higher order units and exhibit possibly related performance on components of a scale of interest. The procedure is developed within the…

Anxiety is one of the most pervasive symptoms seen in clinical psychological disorders. The Beck Anxiety Inventory (BAI) is a popular measure to assess the construct of anxiety. This study was concerned with an examination of potential study factors that are associated with the variability of the reliability estimates of the BAI scores. A review…

Unlike a substantial part of reliability literature in the past, this article is concerned with weighted combinations of a given set of congeneric measures with uncorrelated errors. The relationship between maximal coefficient alpha and maximal reliability for such composites is initially dealt with, and it is shown that the former is a lower…

Data Envelopment Analysis has become a popular tool for evaluating the efficiency of decision making units. The nonparametric approach has been widely applied to educational production. The approach is, however, deterministic and leads to biased estimates of performance in the presence of measurement error. Numerous simulation studies confirm the…

The 160-item short form of the Personality Assessment Inventory (PAI) was developed for situations in which respondents complete only the 1st half of the test. The present study evaluates the adequacy and comparability of the full and short forms of the PAI in terms of a wide range of psychometric characteristics. In all, 421 participants…

A coefficient of unfairness in the allocation of goods to people can be extended to measuring consensus among judges. The notion of relative variability underlies the formation of these measures.

This article discusses the rationale for, and explicates the process used in, developing differentiated authentic assessments for middle school classrooms (many of which contain gifted students) that are aligned with state academic standards. The assessments were developed based on learner-centered psychological principles and revised based on a…

A reliability generalization study was completed on the Patterns of Adaptive Learning Survey achievement goal orientation scales to assess the prediction of (a) the different orientation scales, (b) the adaptation of items to meet research needs, (c) the number of respondents completing the instrument, and (d) the publication date cited for the…

This article addresses the problem of accounting overall multivariate chance-corrected interobserver agreement when targets have been rated by different sets of judges (not necessarily equal in number). The proposed approach builds on Janson and Olsson's multivariate generalization of Cohen's kappa but incorporates weighting for number of judges…

In an attempt to gain a fuller understanding of the basis of grading, ten assessors each assessed two portfolios drawn from the course archive which had been produced by participants on a course in teaching in higher education. Assessors gave a grade or judgement on each of a portfolio's 75 portfolio elements, reasons for each judgement they made,…

This article introduces a procedure for estimating reliability in which equivalent halves of a given test are systematically created and then administered a few days apart so that transient error can be included in the error calculus. The procedure not only estimates complete reliability (taking into account both specific-factor error and…

The ISI Impact Factor for "JOBM" is 1.793, placing it third in the JCR rankings for journals in applied psychology with a sharply accelerating linear trend over the past 5 years. This article reviews the Impact Factor and raises questions regarding its reliability and validity and then considers a citation analysis of "JOBM" in light of the…

A multi-informant study investigated the association between deception capacities and subtypes of aggression in a young early childhood sample (M=44.65 months of age, SD=13.39, N=64). A newly developed teacher report of deception had appropriate psychometric properties (reliability, concurrent validity, and construct validity). Recently introduced…