This article addresses some of the challenges faced when attempting to evaluate the long-term impact of informal science learning interventions. To contribute to the methodological development of informal science learning research, we critically examine (Falk and Needham (2011) "Journal of Research in Science Teaching," 48: 1-12.) study…

Provides an orientation to the special journal issue on research methods in science education and lists four questions to which the contributing authors were asked to respond. (PEB)

Basic characteristics of survey as a research study are discussed. Issues associated with survey research, potential uses of survey research as a strategy in science education, and potential problems jeopardizing survey studies are also discussed. (JN)

Comments on a journal article that suggests that educational statistics may be compared even in cases where different experimental units are used in the analyses. (MLH)

The importance of reporting explained variance in ANOVA designs is discussed. Three methods that can be used to obtain estimates of explained variance in ANOVA designs are described and applied to sixteen studies that were reported in recent NARST volumes. Recommends that researchers in science education report explained variance. (Author/DS)

Examined three methods which can be used to pool single-item-per-subject data collected in intensive time-series studies, determining if method of pooling has an effect on subsequent data analysis. Methods examined were based on simple averaging, difficulty weightings of averages, and the application of the Rasch logistic model. (JM)

Lists six problems related to descriptive data and to factor analysis performed in a previous research study reported in this journal. Includes the authors' response to the suggested weaknesses of their study. (JN)

This article offers five research criteria and their rationale to help researchers avoid problems and to help them improve research. Improving research should improve the quality of science teaching. The treatment of causal hypotheses is stressed. (Author/CW)

To determine whether practice was consistent with recommended research methods, this study examined 130 studies reported over a 5-year period in the "Journal of Research in Science Teaching." Results show that appropriate generalizations beyond the confines of the reported studies may be impossible in most (64%) of the studies.…

Discusses three weaknesses in reporting research findings by commenting and criticizing research articles published in the eighth volume of Journal of Research in Science Teaching. (CC)

Discusses quasi-experimental and experimental research methodologies for investigating the relationships among teacher behavior, teacher competencies, student achievement, and student attitude outcomes. (MLH)

Reports research concerning the definition of variables by pupils ages 12 to 14 during investigative work. Findings suggest that an increase in the complexity of an investigation lowers the ability to identify relevant variables and substantive concepts intrude on the ability to define the appropriate dependent variable and to control variables.…

Examined is how research informs and influences the practice of science education. Discussed are past focuses on treatments, present focuses on students' ideas, and developing styles of research. (YP)

The use of the expert-novice technique in science education is examined critically. Discussed are four techniques including their methodological limitations. Improvements and alternatives in experimental design are suggested. (Author/CW)

Argues that research for teacher use would be more effective if it were: (1) of the form referred to as naturalistic case studies and (2) oriented toward discovering cognitive and social interaction mechanisms underlying the learning processes in classrooms. (Author/SK)