A method for incorporating maximum likelihood (ML) estimation into reliability analyses with item-level missing data is outlined. An ML estimate of the covariance matrix is first obtained using the expectation maximization (EM) algorithm, and coefficient alpha is subsequently computed using standard formulae. A simulation study demonstrated that…

This article introduces a new test-centered standard-setting method as well as a procedure to detect intrajudge inconsistency of the method. The standard-setting method that is based on interdependent evaluations of alternative responses has judges closely evaluate the process that examinees use to solve multiple-choice items. The new method is…

Goodness-of-fit (GOF) indexes provide "rules of thumb"?recommended cutoff values for assessing fit in structural equation modeling. Hu and Bentler (1999) proposed a more rigorous approach to evaluating decision rules based on GOF indexes and, on this basis, proposed new and more stringent cutoff values for many indexes. This article discusses…

Two techniques for determining a straight line fit to data are compared. This article reviews two simple techniques for fitting a straight line to a set of data, namely the method of averages and the method of least squares. These methods are compared by showing the results of a simple analysis, together with a number of tests based on randomized…

Structural equation modeling (SEM) offers a flexible method for studying the patterns of interdependence in partners' behavior, which lie at the heart of interactions and relationships. Although SEM has been applied to the study of distinguishable dyads, in which partners are distinguishable by type, such as male and female, it has rarely been…

Little is known about researchers' understanding of confidence intervals (CIs) and standard error (SE) bars. Authors of journal articles in psychology, behavioral neuroscience, and medicine were invited to visit a Web site where they adjusted a figure until they judged 2 means, with error bars, to be just statistically significantly different (p…

Finding, accessing, and determining the credibility of information are skills most people would deem necessary for the college educated person, if not the average citizen, to possess today. At the same time, educators, as well as constituents of educational institutions are asking for better and more sophisticated assessment instruments of…

A latent variable modeling approach to reliability and measurement invariance evaluation for multiple-component measuring instruments is outlined. An initial discussion deals with the limitations of coefficient alpha, a frequently used index of composite reliability. A widely and readily applicable structural modeling framework is next described…

Value-added models in education research allow researchers to explore how a wide variety of policies and measured school inputs affect the academic performance of students. Researchers typically quantify the impacts of such interventions in terms of "effect sizes", i.e., the estimated effect of a one standard deviation change in the…

General self-efficacy (GSE), individuals' belief in their ability to perform well in a variety of situations, has been the subject of increasing research attention. However, the psychometric properties (e.g., reliability, validity) associated with the scores on GSE measures have been criticized, which has hindered efforts to further establish the…

M. J. Kolen, B. A. Hanson, and R. L. Brennan (1992) presented a procedure for assessing the conditional standard error of measurement (CSEM) of scale scores using a strong true-score model. They also investigated the ways of using nonlinear transformation from number-correct raw score to scale score to equalize the conditional standard error along…

The 1991 Survey of Recent College Graduates (RCG:91) is the sixth study in a series begun in 1976. The series provides data on the occupational and educational outcomes of recent bachelor's and master's graduates one year after graduation. The survey was conducted by Westat, Inc. in a two-stage sample involving 400 institutions of higher education…

Errors in item parameter estimates have a negative impact on the accuracy of item and test information functions. The estimation errors may be random, but because items with higher levels of discriminating power are more likely to be selected for a test, and these items are most apt to contain positive errors, the result is that item information…

R. J. Owen (1975) proposed an approximate empirical Bayes procedure for item selection in adaptive testing. The procedure replaces the true posterior by a normal approximation with closed-form expressions for its first two moments. This approximation was necessary to minimize the computational complexity involved in a fully Bayesian approach, but…

An analysis of covariance (ANCOVA) is done to correct for chance differences that occur when subjects are assigned randomly to treatment groups. When properly used, this correction results in adjustment of the group means for pre-existing differences caused by sampling error and reduction of the size of the error variance of the analysis. The…