The phenomenon of scale shrinkage is examined. Focus is on the pattern of decreasing variances in item response theory scale scores from fall to spring within a grade. It is demonstrated that questions concerning population distributions of true ability can be addressed with empirical Bayes techniques. (TJH)

Implications of ignoring correlated error on parameter estimates in some simple structural equation models are examined. It is shown analytically and empirically through simulation that ignoring positive between-construct correlated error overestimates the structural parameter linking the two constructs. Effects become more pronounced with…

Conclusions about peer-group influences on academic achievement often depend on the estimation method used to account for endogeneity of school and neighborhood choice. Using High School and Beyond Longitudinal Survey data, this paper shows that aggregation does not reduce the specification error in estimating peer-group benefits. (Contains 25…

Presents a multidimensional conceptualization of family functioning that is embedded within a family systems framework. Discusses operational issues pertaining to the assessment of family functioning when conceived of as a complex and multidimensional construct, and explores measurement strategies and analytical approaches. (JPS)

Psychometricians continue to develop and evaluate methods for linking test scores, both horizontally and vertically. This article describes a social moderation process for articulating (i.e., linking) performance standards across grade levels for an operational state assessment program. The researchers used generated data to evaluate the likely…

In this article, a maximum likelihood approach is developed to analyze structural equation models with dichotomous variables that are common in behavioral, psychological and social research. To assess nonlinear causal effects among the latent variables, the structural equation in the model is defined by a nonlinear function. The basic idea of the…

The crux in psychometrics is how to estimate the probability that a respondent answers an item correctly on one occasion out of many. Under the current testing paradigm this probability is estimated using all kinds of statistical techniques and mathematical modeling. Multiple evaluation is a new testing paradigm using the person's own personal…

This chapter summarizes the most recent literature on the best practices of Web survey implementation and offers practical advice for researchers. (Contains 1 table.)

Coefficient alpha, the most commonly used estimate of internal consistency, is often considered a lower bound estimate of reliability, though the extent of its underestimation is not typically known. Many researchers are unaware that coefficient alpha is based on the essentially tau-equivalent measurement model. It is the violation of the…

This article examines the intersection of psychometrics and sociolinguists in the testing of English language learners (ELLs); it discusses language, dialect, and register as sources of measurement error. Research findings show that the dialect of the language in which students are tested (e.g., local or standard English) is as important as…

The relationship between intelligence and personality has been of scientific interest for over 100 years. However, most contemporary estimates of these relationships are limited because they do not separate the variance due to general and narrow cognitive abilities. This study demonstrates that this methodological oversight can distort estimates…

A statistical test for detecting answer copying on multiple-choice tests based on Cohen's kappa is proposed. The test is free of any assumptions on the response processes of the examinees suspected of copying and having served as the source, except for the usual assumption that these processes are probabilistic. Because the asymptotic null and…

This paper sets out the findings from a large-scale analysis of the Northern Ireland Transfer Procedure Tests, used to select pupils for grammar schools. As it was not possible to get completed test scripts from government agencies, over 3000 practice scripts were completed in simulated conditions and were analysed to establish whether the tests…

The standard error of measurement usefully provides confidence limits for scores in a given test, but is it possible to quantify the reliability of a test with just a single number that allows comparison of tests of different format? Reliability coefficients do not do this, being dependent on the spread of examinee attainment. Better in this…

This paper compares the approach and resultant outcomes of item response models (IRMs) and classical test theory (CTT). First, it reviews basic ideas of CTT, and compares them to the ideas about using IRMs introduced in an earlier paper. It then applies a comparison scheme based on the AERA/APA/NCME "Standards for Educational and…