The recently developed log-linear model technique for the analysis of contingency tables has many potential applications within educational research. This paper describes the two major models, log-linear and logit-linear, that are employed under this approach. (Author/JKS)

Randomization tests involve generating all possible assignments of subjects to treatments in order to create a distribution of possible test statistics. The use of a premutation group to enhance the understanding and utility of randomization tests is discussed. (Author/JKS)

Logically consistent hypothesis-testing for factorial analysis of variance designs is proposed in the context of a hierarchical model. It is shown that all of the hypotheses associated with the traditional factorial model are conceptually independent and occupy the lowest levels of the hierarchy. (Author/JKS)

A statistical analysis procedure is developed, based on the notion that many educational programs are dynamic interventions in natural growth processes, and is called value-added analysis. The theory of value-added analysis, and several applications are presented. (Author/JKS)

Glass's estimator of effect size, the sample mean difference divided by the sample standard deviation, is studied in the context of an explicit statistical model. The exact distribution of Glass's estimator is obtained and the estimator is shown to have a small sample bias. Alternatives are proposed and discussed. (Author/JKS)

The evaluation of competing analysis strategies based on estimator bias and variance is demonstrated using gains in standard scores and analysis of covariance procedures for quasi-experiments conforming to the fan-spread hypothesis. The findings do not lead to a uniform recommendation of either approach. (Author/JKS)

The nature of experimental designs in the evaluation of educational programs is addressed in this commentary on the evaluation of the Emergency School Aid Act and a paper detailing that evaluation (TM 503 672). (JKS)

Incidence sampling is a parsimonious method whereby a large number of examinees can be measured on many variables (such as test items) to assess group characteristics. Parameters used to describe an incidence sample are estimated using the theory of generalized symmetric means and generalizability theory. (Author/JKS)

The evaluators of the Emergency School Aid Act respond to commentaries on their evaluation of the act and their article detailing that evaluation (TM 503 672). Each commentary is discussed. (See TM 503 673 through 678). (JKS)

Problems encountered in large-scale educational evaluations are discussed using the evaluation of the Emergency School Aid Act as an example. This extensive article focuses primarily on methodological issues. (JKS)

This chapter gives an overview of the design and statistical and psychometric analysis methods of the National Assessment of Educational Progress (NAEP). The evolution of the NAEP continues to provide challenges to statisticians and psychometricians, as demonstrated in the expansion of the NAEP to the assessment of individual states. (SLD)

Procedures for obtaining student samples for the National Assessment of Educational Progress (NAEP) and deriving survey weights for analysis of survey data are described. Sample designs are economically and operationally feasible, and weighting procedures result in increased precision of estimates as they account for the probabilities of student…