This paper puts forward a research agenda in the area of explicit and implicit knowledge and learning of second or additional languages. Based on a brief overview of reliable findings as well as open questions in the field, three agenda items are highlighted. First, valid and reliable measures of explicit and, in particular, implicit knowledge and…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

The problem with most commissioned studies is that they are generally anchored on research protocols, guidelines and theoretical underpinnings imposed by research grant makers or the external Principal Investigator's (PI) own research design preferences. Furthermore, the problem is that researchers who are recruited during various phases of…

Realist evaluation (RE) is a research design increasingly used in program evaluation, that aims to explore and understand the influence of context and underlying mechanisms on intervention or program outcomes. Several methodological challenges, however, are associated with this approach. This article summarizes RE key principles and examines some…

Factorial surveys use a population of vignettes to elicit respondents' attitudes or beliefs about different hypothetical scenarios. However, the vignette population is frequently too large to be assessed by each respondent. Experimental designs such as randomized block confounded factorial (RBCF) designs, D-optimal designs, or random sampling…

David Berliner argued in 2002 that educational research is the hardest science of all. His arguments addressed the complexity that context plays in educational settings and the difficulties of applying research designs that were largely developed and refined in the natural sciences arena to fields of human behavior. In this article, it is argued…

For more than four decades the National Assessment of Educational Progress (NAEP) has tracked the achievement of U.S. students in major academic subjects. This national resource is the only assessment that states and now many urban districts can look to as an objective yardstick of their performance over time, relative to national benchmarks, and…

In engaging in research we draw upon and develop meanings and concepts that help to frame what we do, how we do it and the meaning we make of it. In the process of framing, we exclude other possibilities from our research practices. To do research, then, is to engage in the fashioning of conceptual boundaries. This article explores the dilemmas of…

The development of the between-class, within-class analysis has facilitated a more refined analysis of classroom processes and influences: those which affect a class as a whole, a student within a class, or an individual student independent of context. However, a problem arises in using a between-class, within-class analysis to infer a particular…

Mothers' behavioral intentions about using physical punishment were examined to reveal influences on their selection of responses to child misbehaviors. Participants were 55 middle-class, mostly college-educated mothers of 3-to-4-year-old children. A total of 31 children were girls. Mothers operated a computer program which presented, in a random…

Considers how sociohistorical context affects procedures by which sociologists obtain subject permission for interviews and audiotaping interviews. Reviews a 1950s study involving interviews with institutionalized, schizophrenic women contrasting ethical and institutional implications of informed consent in that context to contemporary informed…

Reviews research focusing on teacher influence on student academic outcomes. Findings on both sides of the issue are discussed; reasons for the indeterminancy of findings are specified; and relationships between presage, context, process, and product classroom variables are discussed. (RH)

This paper discusses several considerations and techniques in doing research which attempts to measure the effects of visual images on viewers. For example, to describe precisely the effects of some element of a visual image or series of images, researchers must be able to specify the institutional context in which the image is presented and…

Sensitivity to context variables marks the third phase of effective schools research (ESR). The first phase was one of explicit concern for equity, challenging the works of Coleman and Jencks which suggested that achievement differences were more associated with family background than school variables. This research focused on low socioeconomic…

After a brief introduction indicating the value of the first Follow Through evaluation, this document offers ideas about how a new wave of Follow Through approaches should be evaluated. The discussion is based on the premise that the form of an evaluation must be derived from the questions for which answers are sought, the audience(s) to whom the…