Discusses the need in designing educational studies to give more attention to recognizing the universe of generalization and to incorporate into the design a variable that represents the universe. Data analytic techniques should treat the levels of this variable as randomly selected from the universe. (Author/JEG)

The main energy of this investigation focused on the viability of different forms of assessing the quality of compositions written by ten- to eleven-year-old children. (Author/RK)

Recent criticism in the literature of the use of inferential statistics in educational research is refuted. The authors focus on the defense of multiple regression analysis. (JKS)

This interim report is concerned with the analysis of educational experiments and quasiexperiments where alternative teaching methods are applied to intact classes or where alternative programs are set up in samples of schools or communities. Generally, such studies have used the class, the school, or the community as the unit of sampling with the…

Four approaches to estimating interrater reliability in early childhood special education research are illustrated and compared: correlation, comparison of means, percentage of agreement, and generalizability theory techniques. Generalizability theory techniques are proposed as a method for estimating the amount of variance attributable to…

The designs for measuring the effectiveness of personalized educational prescriptions in a pilot second-grade classroom for the first and second years are presented. The analysis of pretest and posttest data is also given. (See TM 001 363 for summary report of the project; for other related documents, see TM 001 160, 365-374.) (MS)

The authors state that multiple regression is a powerful method of statistical analysis, provides a strength of relationship index, and should replace analysis of variance (ANOVA) in educational research. They also discuss the coding of categorical variables and available computer programs for multiple regression. (Author/MH)

The present paper contributes to research methodology as practiced in the field by providing practitioners with a concise statement of the problems in analyzing unbalanced designs, and by clarifying the conditions under which the analysis alternatives are most appropriate. The purposes of the present paper are: (1) to examine the analysis…

The degree to which the chosen units of analysis are likely to produce spurious findings in staged combinations of multiple linear regression procedures are examined. The effects of grouping variables (e.g., classroom, school, and school district) on Procedures such as Coleman's semipartial regression and Mayeske's commonalities, in light of…

This paper discusses the problems of gathering and analyzing data on classroom behaviors. The difficulties involved in using the common pretest-posttest experimental design are described. To grapple with these problems, a study was conducted on the effect of environmental changes on student behavior, employing a time-series design and time-series…

Hypothetical data sets are used to demonstrate how canonical correlation methods subsume other commonly utilized parametric methods. Analysis of variance, analysis of covariance, multiple analysis of variance, and multiple analysis of covariance are heavily used by educational researchers. It is concluded that researchers would do well to consider…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

Three common methodological problems in the analysis of observational data include: (1) failure to base degrees of freedom for the analysis on the appropriate sampling unit; (2) the validity of the design and data are inconsistent with the generalizations reached; (3) the statistic used to calculate coder reliability is often inappropriate and…

It is argued in this paper that generalizability theory provides a uniquely useful framework for defining and quantifying the dependability of data for decision making. It does so by requiring careful specification of the conditions of measurement and the anticipated sources of variation in the results of the measurement procedure. A distinction…

298 EDUCATIONAL AND PSYCHOLOGICAL RESEARCH PAPERS PUBLISHED IN 5 JOURNALS DURING 1966-67 WERE CLASSIFIED ON THE BASIS OF SPONSORSHIP, AUTHORS' GENERAL INTENTIONS, DESIGN, ASSUMPTIONS, AND ANALYSIS. ADVANCES IN STATISTICAL THEORY (INCLUDING WORK ON GENERAL ANALYSIS OF VARIANCE DESIGNS, HYPOTHESIS TESTING IN FACTOR ANALYSIS, MULTIVARIATE ANALYSIS,…