Describes hypothesis validity as extent to which research results reflect theoretically derived predictions about relations between or among constructs. Discusses role of hypotheses in theory testing. Presents four threats to hypothesis validity: (1) inconsequential research hypotheses; (2) ambiguous research hypotheses; (3) noncongruence of…

Tests the hypotheses that overconfidence occurs when strength is high and weight is low and that underconfidence occurs when weight is high and strength is low in 4 experiments with 153 students. Discusses weighing evidence, overconfidence/underconfidence in intuitive judgments, and item difficulty's effect on overconfidence. Relates the…

Problems associated with randomization tests in single- case experiments are discussed. This article follows a discussion of randomization tests in single case studies in the same issue of this journal. (See TM 505 799; 505 801).(Author/JKS)

The decisive power of an experiment, for both social evaluation research and laboratory experimentation as well, is only as strong as the clarity of the basic assumptions which underlie it. A dialectical methodology is proposed for assessing the influence of key assumptions in both settings. (Author/CTM)

The central thesis of this article is that the process of eliminating validity threats depends fundamentally on no-difference findings, a fact that has not been made explicit by researchers. The implications of this neglect are explored using examples from a number of different substantive areas such as psychology, health, and medicine.…

Statistical methods for program evaluation with nonexperimental data are reviewed with emphasis on circumstances in which nonexperimental data are valid. Three solutions are proposed for problems of selection bias, and implications for evaluation design and data collection and analysis are discussed. (SLD)

Dismissing research that is not theory driven, hypothesis testing, or generalization producing does injustice to the variety of contributions that qualitative research can make. Studies conducted through qualitative approaches are reviewed to summarize the desirable outcomes that can result. No research model has a monopoly on quality. (SLD)

Discusses five common myths about statistical significance testing (SST), the possible erroneous and harmful contributions of SST to educational research, and suggested alternatives to SST for mathematics education research. (Contains 61 references.) (MKR)

In order to make policy decisions, educators must evaluate educational research proposals and projects. Findings immediately related to practice are often inadequate, omitting the theoretical establishment of principles by which we can explain and predict the phenomena of our world. These theoretical linkages to the practical world of…