This position paper examines the phenomenon of the McNamara Fallacy to analyse flawed conceptions of "success" in mathematics learning, normalised assessment structures and their implications for mathematics education. The established presence of the McNamara Fallacy and the ramifications of this statistical fallacy provide a foundation…

Several programs of research have sought to assess the replicability of scientific findings in different fields, including economics and psychology. These programs attempt to replicate several findings and use the results to say something about large-scale patterns of replicability in a field. However, little work has been done to understand the…

This article looks back at several of the classic ethnographies in British sociology of education and shows that quantitative work played a significant part in many of them, and that quantitative results were part of the evidence used to support claims and arguments put forward by the authors. The article then examines some more recent…

Scientific research often involves testing more than one hypothesis at a time, which can inflate the probability that a Type I error (false discovery) will occur. To prevent this Type I error inflation, adjustments can be made to the testing procedure that compensate for the number of tests. Yet many researchers believe that such adjustments are…

Student reasoning about cases of natural selection is often plagued by errors that stem from miscategorising selection as a direct, causal process, misunderstanding the role of randomness, and from the intuitive ideas of intentionality, teleology and essentialism. The common thread throughout many of these reasoning errors is a failure to apply…

Factor analysis has been frequently exploited in applied research to provide evidence about the underlying factors in various measurement instruments. A close inspection of a large number of studies published in leading applied linguistic journals shows that there is a misconception among applied linguists as to the relative merits of exploratory…

Overlap-based measures are increasingly applied in the synthesis of single-subject research. This article considers two criticisms of overlap-based metrics, specifically that they do not measure magnitude of effect and do not adequately correspond with visual analysis. It is argued that these criticisms are based on fundamental misconceptions…

This article examines a recent example of published research on the vocabulary profile of a financial corpus based on the Academic Word List (AWL) to illustrate not only the erroneous output from vocabulary profiling tools but also the pitfalls of using the AWL as a filter for academic lexis. Recent research has cautioned against eschewing high…

How doctoral programs train future researchers in quantitative methods has important implications for the quality of scientifically based research in education. The purpose of this article, therefore, is to examine how quantitative methods are used in the literature and taught in doctoral programs. Evidence points to deficiencies in quantitative…

This article reviews the concepts and methods of Bayesian statistical analysis, which can offer innovative and powerful solutions to some challenging analytical problems that characterize developmental research. In this article, we demonstrate the utility of Bayesian analysis, explain its unique adeptness in some circumstances, address some…

There is a misconception among social scientists that statistical analysis is somehow a technical, essentially objective, process of decision-making, whereas other forms of data analysis are judgement-based, subjective and far from technical. This paper focuses on the former part of the misconception, showing, rather, that statistical analysis…

The aim of this study was to investigate effectiveness of PDEODE (Predict-Discuss-Explain-Observe-Discuss-Explain) teaching strategy in helping students make sense of everyday situations. For this, condensation concept was chosen among many science concepts since it is related to many everyday-life events. Forty-eight eleventh graders students…

Describes the statistical paradoxes that arise when unit costs, averages, rates, ratios, percentages, or proportions are compared. The discussion covers the possible misinterpretation of library statistics resulting from these paradoxes, using as an example the Association of Research Libraries statistics on average expenditure per added volume.…

In a recent article in this journal, Lombard, Snyder-Duch, and Bracken (2002) surveyed 200 content analyses for their reporting of reliability tests, compared the virtues and drawbacks of five popular reliability measures, and proposed guidelines and standards for their use. Their discussion revealed that numerous misconceptions circulate in the…

Regardless of how many times people are told by the Educational Testing Service not to use the Scholastic Aptitude Test (SAT) as a gross measure of school productivity, the test continues to be used for that purpose. This article shows how misleading SAT scores and per-student-expenditure correlations are used to justify spending less money on…