Context: A perennial problem in applied statistics is the inability to justify strong claims about cause-and-effect relationships without full knowledge of the mechanism determining selection into treatment. Few research designs other than the well-implemented random assignment study meet this requirement. Researchers have proposed partial…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

The integration of ideas, methods, and data from diverse disciplines has been a transformative force in science and higher education, attracting policy interventions, program innovations, financial resources, and talented people. Much energy has been invested in producing a new generation of scientists trained to work fluidly across disciplines,…

This highly readable text demystifies the qualitative research process--and helps readers conceptualize their own studies--by organizing the different research paradigms and traditions into coherent clusters. Real-world examples and firsthand perspectives illustrate the research process; instructive exercises and activities build on each other so…

Author responds to critique by Daniel Griffiths (Educational Administration Quarterly v. 19, p. 201-21) by defending his work in three areas: derivation of hypotheses, testing of hypotheses, and erroneous attribution of assumptions. (JW)

This paper critically reviews administrator work activity studies which follow the research of Henry Mintzberg. It discusses directions for future research using qualitative and quantitative methods and discourages research that relies solely on Mintzberg's structure. (Author/JAZ)

A method is presented for determining the optimal number of conditions to use in measurement designs when resource constraints are imposed. The method is illustrated using a multivariate two-facet design, and extensions to other designs are discussed. (SLD)

While presenting a critical look at selected aspects of relationship change research and theory, this essay argues that researchers need to investigate a broader range of relationship types, develop a more comprehensive conceptualization of relationship change, and develop more appropriate research methods. The first section deals with the need to…

An investigation was conducted of the characteristics of two estimation procedures and corresponding test statistics used in the analysis of completely randomized factorial experiments when observations are lost at random. For one estimator, contrast coefficients for cell means did not involve the cell frequencies. For the other, contrast…

Explanations are offered for observed discrepant and null findings in the area of predictive information about teacher effectiveness. It is argued that if tautologies are to be avoided, only product variables are appropriate criteria of success. Some recommendations regarding future research are offered. (Author/GSK)

Model identification of time-series data is essential to valid statistical tests of intervention effects. Model identification is, at best, inexact in the social and behavioral sciences where one is often confronted with small numbers of observations. These problems are discussed, and the results of independent identifications of 130 social and…

Generalizability theory, which subsumes classical measurement theory as a special case, provides a general model for estimating the reliability of observational rating data by estimating the variance components of the measurement design. Research data from the "Heart Smart" health intervention program were analyzed as a heuristic tool.…

These guidelines are intended to help those who design and conduct investigations of psychopharmacologic agents in children. A progression of studies in four phases is advocated. First, early short term studies should establish single and multiple dose safety baselines. Second, early pilot efficacy studies may be initiated jointly with longer…

Designed to alleviate the confusion caused by the existence of a multiplicity of approaches to writing research, the four parts of this book present explicit discussions of research principles and methods used by researchers actively working within a variety of disciplines. The two chapters in Part 1 describe very broad views of the entire…