In this study, we examined the potential impact of item misfit on the reported scores of an admission test from the subpopulation invariance perspective. The target population of the test consisted of 3 major subgroups with different geographic regions. We used the logistic regression function to estimate item parameters of the operational items…

Group awareness can affect student online learning while self-regulation also can substantially influence student online learning. Although some studies identify that these two variables may partially determine learning behavior, few empirical studies or thorough analyses elucidate the simultaneous impact of these two variables (group awareness…

Few studies have investigated the effects of the instructions provided in educational computer games on cognitive processing and learning outcomes. In our experiment, we sought to compare the effects on learning outcomes of two different types of goal-oriented instructions: "mastery-goal" instructions, which prompt learners to develop…

A statistical method, Fishers Table of t (or t ratio), is used to determine the statistical significance of a comparison of results from pretests and post-tests of knowledge and skill taken by training program participants. A statistically significant improvement can demonstrate training effectiveness. (MS)

Conventional methods used for the presentation of pre- and post statistical information generally are deficient in economy and compactness and fail to show internal movement from pre- to posttest. This technique precludes these shortcomings through the presentation of information in a highly visible manner which reveals the strata of internal…

The measurement of change in quasi-experimental educational research was discussed. Problems related to measuring change exist to varying degrees in all research designs; these issues are less troublesome in experimental studies because the investigator can manipulate the interest variables and observe their effects on other variables. Measuring…

It is unsafe to estimate achievement test norms for fall testing by linear interpolation between norms for the previous spring testing and norms for the following spring. Second grade students were tested in reading and arithmetic in the fall and in the spring to provide pre-test and post-test data for evaluation of academic growth. Three…

The present study was undertaken to assess whether training that was known to produce transfer within the Cognition of Figural Relations (CFR) domain of Guilford's Structure-of-Intellect model would also produce transfer to other operations in Guilford's model. Fifty subjects, matched for pretest score on a double classification task, were…

The four main approaches to measuring treatment effects in schools; raw gain, residual gain, covariance, and true scores; were compared. A simulation study showed true score analysis produced a large number of Type-I errors. When corrected for this error, this method showed the least power of the four. This outcome was clearly the result of the…

The role that measurement error plays in the regression effect is discussed with particular reference to the RMC models for evaluating the effects of Elementary Secondary Education Act Title I programs. The norm referenced evaluation model assumes a theory of growth where the relative ranking of students remains the same from pretest to posttest…

The study compares the content retention by students who are self-paced with content retention by students whose pacing is modified by instructors. The subjects included 148 students enrolled in an introductory college level child development course. One group of 74 students was randomly assigned to a self-paced section and another group of 74…

When two groups, initially dissimilar, undergo different treatments, can subsequent differences be partitioned in such a way that the difference between the two treatments is unbiased? This is the central problem of this paper, and it is confronted by the examination of two levels of information using a Follow Through Evaluation. The first…

Two methods of reading instruction (homogeneous grouping and graded classes) are compared for 165 students in 8 rural North Dakota schools by raw gain scores, residual gain scores, and the analysis of covariance. (CK)

An application of evaluation methodology to innovative educational programs through a case study of a Chicago suburban high school program for alternative education is presented. The evaluation methodology encompasses the difficulty in combining comparative programs, individual-diagnostic, and individual developmental measures, the selection of…

A project to upgrade knowledge and skills of junior high school students in American history was conducted in four cities and counties in Virginia during 1977-78. The hypothesis was that students who received feedback from teachers regarding performance on an American history pre-test would perform better on a subsequent American history test.…