Failure to consider errors of measurement when using partial correlation or analysis of covariance techniques can result in erroneous conclusions. Certain aspects of this problem are discussed and particular attention is given to issues raised in a recent article by Brewar, Campbell, and Crano. (Author)

Item parameter estimates vary for a variety of reasons, including estimation error, characteristics of the examinee samples, and context effects (e.g., item location effects, section location effects, etc.). Although we expect variation based on theory, there is reason to believe that observed variation in item parameter estimates exceeds what…

The paper initially describes the sources of uncertainty in National Assessment of Educational Progress (NAEP) data and standard errors. As NAEP sample sizes have increased, greater precision has been attained by the program. For this reason, exclusion effects are increasingly important. Two scenarios of revised NAEP results are presented (for New…

School test performance is commonly summarized in terms of the percentage of students at or above a cut score (PAAC) that has been set on a test. Two approaches to estimating the standard errors for school PAACs were examined in this study: conditional standard errors and overall standard errors. The tests used were English language arts and…

Generalizability theory is used to examine the psychometric characteristics of the Listening and Writing Tests developed by American College Testing for its Work Keys program. Results with samples of 50 suggest the desirability of a minimum number of the tests' tape-recorded messages and the use of at least 2 raters. (SLD)

In studies of relatives, conventional multiple regression may not be appropriate because observations are not independent. Obtaining estimates of regression coefficients and correct standard errors from these populations through a structural equation modeling framework is discussed and illustrated with data from twins. (SLD)

A conceptual approach and a set of computer simulations are presented to demonstrate that random measurement error in the pretest does not bias the estimate of the treatment effect in the regression-discontinuity design. Focus is on the case of no interaction between pretest and treatment on posttest. (SLD)

The aim of the review of D.V. Cicchetti, A.S. Kaufman, and S.S. Sparrow (funded by the General Electric Company; this issue) is to "evaluate [the] literature relating the effects of prenatal and postnatal exposure to polychlorinated biphenyls (PCBs) upon neurobehavioral, health-related, and cognitive deficits in neonates, developing infants,…

This invited response to the paper by D.V. Cicchetti, A.S. Kaufman, and S.S. Sparrow (CKS), and the responses by the investigative teams of the studies criticized by them, addresses specific errors of logic and interpretation by CKS, and integrates comments made by the study investigators. CKS provide a flawed analysis of the literature on the…

This study provides information about the total and component scores of the Test of English as a Foreign Language (TOEFL). First, the study provides comparative global and component estimates of test-retest, alternate-form, and internal-consistency reliability, controlling for sources of measurement error inherent in the examinees and the testing…

Over the last 15 years or so, research into measurement error has begun to consider not just whether the test items fit, but whether the people who answer the items fit. Attempts to systematically identify people who do not fit the typical pattern have led to several "person-fit statistics." This digest describes the need for such…

In response to the federal goal to connect all of the nation's school classrooms, libraries, hospitals, and law enforcement agencies to the information superhighway, the Department of Education commissioned a survey to obtain baseline data on the status of advanced telecommunications in public elementary and secondary schools. Data was gathered…

Although the standard-setting method of W. H. Angoff (1971) has broad-based support in the research literature, inconsistencies in the resulting standards do occur. Sources of these inconsistencies are examined in a study of judges, competencies (items), rounds (replications), and the interactions among them. A modified Angoff approach was used to…

A study was conducted to assess the reliability of the College-Level Academic Skills Test (CLAST) for the major ethnic groups in Florida; and to develop a standard error of measurement for the critical group that fell close to the cut score on each test. The October 1983 and March 1984 administrations of the CLAST were analyzed to determine…

The Bureau of Labor Statistics (BLS) publishes the official unemployment rate on the first Friday of each month based on a sample survey of 59,500 households called the Current Population Survey. Unemployment data for states and local areas are published monthly by the BLS in cooperation with the state employment security agencies. The primary…