Action research often necessitates the use of intact groups for the comparison of educational treatments or programs. This paper considers several analytical methods that might be used for such situations when pretest scores indicate that these intact groups differ significantly initially. The methods considered include gain score analysis of…

Rasch calibration permitted the development of short achievement tests that were economical in testing time, and could be developed in a series of difficulty levels to suit student individual differences. Furthermore, these tests were of adequate reliability for practical educational measurement when individual students were assigned to tests of…

Describes two simple methods of error analysis: (1) combining errors in the measured quantities; and (2) calculating the error or uncertainty in the slope of a straight-line graph. Discusses significance of the error in the comparison of experimental results with some known value. (MDH)

Employing standardized achievement tests to ascertain educational quality is like measuring temperature with a tablespoon. Such tests are prone to testing-teaching mismatches, omitted items, and confounded causation problems. Actually, three factors influence students' scores: what's taught in school, native intellectual ability, and out-of-school…

Process/product instruments of the 1970s attempt to evaluate teaching based on classroom observations. Performance-based teacher assessment is an ineffective, inappropriate method that does not truly assess teaching. Alternative methods (portfolios, student evaluations, peer evaluation, dossiers, and 360-degree feedback) support professional…

Studied the amount of measurement error in a state's performance-based writing task as it relates to high-stakes decision reproducibility. Using 175 eighth-grade writing samples, the study finds moderate correlations between the two raters' scores, with significant differences for the rates for the handwritten, but not the typed, essays.(SLD)

In this paper, we respond to the criticisms and concerns raised by D.V. Cicchetti, A.S. Kaufman, & S.S. Sparrow (this issue) in their review of the PCB literature, with particular attention to our own research in Michigan. We agree that multiple comparisons and functional significance are issues that would benefit from more discussion.…

Bernhardt (2003) claims that half of the variance in second language (L2) reading is accounted for by first language literacy (20%) and second language knowledge (30%), and that one of the central goals of current L2 reading research should be to investigate the 50% of variance that remains unexplained. Part of this variance takes consists of…

The Bureau of Labor Statistics (BLS) projections of occupational employment growth have consistently underpredicted the growth of skilled occupations. BLS currently predicts that professional, technical, and managerial jobs will account for 40.9 percent of employment growth between 1990 and 2005. Forecasting regressions predict these occupations…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

Two studies were carried out to evaluate the quality of multidimensional item response theory (MIRT) model parameter estimates obtained from the computer program NOHARM. The purpose of the first study was to compute empirical estimates of the standard errors of the parameters. In addition, the parameter estimates were evaluated for bias and the…

Possible causes of a 16-point mean score increase for the computer adaptive form of the College Level Academic Skills Test (CLAST) in reading over the paper-and-pencil test (PPT) in reading are examined. The adaptive form of the CLAST was used in a state-wide field test in which reading, writing, and computation scores for approximately 1,000…

This study addresses the test-disclosure-related need for more Graduate Record Examinations (GRE) General Test editions in a situation where the number of examinees is stable or declining. Equating is used to guarantee that examinees of different test editions are treated equitably. The data collection designs used in this study were: (1)…

The New Jersey College Basic Skills Placement Test (NJCBSPT) is designed to measure basic reading, writing, and mathematics skills of students entering New Jersey colleges. The test consists of five sections: Essay, Reading Comprehension, Sentence Sense, Mathematical Computation, and Elementary Algebra. The test is intended to answer the question…

The technology of transforming sentences from prose instruction into test questions was examined by comparing two methods of selecting sentences (keyword vs. rare singleton), two types of question words (nouns vs. adjectives), and two foil construction methods (writer's choice vs. algorithmic). Four item writers created items using each…