Several programs of research have sought to assess the replicability of scientific findings in different fields, including economics and psychology. These programs attempt to replicate several findings and use the results to say something about large-scale patterns of replicability in a field. However, little work has been done to understand the…

When a psychologist announces a new research finding, it is often based on a rejected null hypothesis. However, if that hypothesis is true, the claim is a false alarm. Many students mistakenly believe that the probability of committing a false alarm equals alpha, the criterion for statistical significance, which is typically set at 5%. Instructors…

Q methodology is a method to systematically study subjective matters such as thoughts and beliefs on any given topic. Q methodology can be used for both theory building and theory testing. The purpose of this paper was to give a brief overview of Q methodology to readers with various backgrounds. This paper discussed several advantages of Q…

Conducting research can present a range of challenges for students because of the complex skills and knowledge required to have critical engagement with the entire research process. This paper looks at what was involved in shaping the research journey that I am currently undertaking at a Higher Education Institution (HEI). The focus is on research…

Overlap-based measures are increasingly applied in the synthesis of single-subject research. This article considers two criticisms of overlap-based metrics, specifically that they do not measure magnitude of effect and do not adequately correspond with visual analysis. It is argued that these criticisms are based on fundamental misconceptions…

"Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research" offers a truly balanced, inclusive, and integrated overview of the processes involved in educational research. This text first examines the general steps in the research process and then details the procedures for conducting specific types…

The purpose of this paper is to introduce the process and value of Random Qualitative Validation (RQV) in the development and interpretation of survey data. RQV is a method of gathering clarifying qualitative data that improves the validity of the quantitative analysis. This paper is concerned with validity in relation to the participants'…

Engaging students in active learning can enhance their understanding and appreciation of a subject such as statistics. Classroom activities and projects help to engage students and further promote the learning process. In this paper, an activity investigating the influence of population size and wealth on the medal counts from the 2012 London…

Among the plethora of action research books on the market, there is no one text exclusively devoted to understanding how to acquire and interpret research data. Action Research Methods provides a balanced overview of the quantitative and qualitative methodologies and methods for conducting action research within a variety of educational…

The growth in the availability of longitudinal data--data collected over time on the same individuals--as part of program evaluations has opened up exciting possibilities for evaluators to ask more nuanced questions about how individuals' outcomes change over time. However, in order to leverage longitudinal data to glean these important insights,…

Statistical analysis is one component that cannot be avoided in a quantitative research. Initial observations noted that students in higher education institution faced difficulty analysing quantitative data which were attributed to the confusions of various variable measurements. This paper aims to compare the outcomes of two approaches applied in…

Confidence intervals (CIs) and effect sizes are essential to encourage meta-analytic thinking and to accumulate research findings. CIs provide a range of plausible values for population parameters with a degree of confidence that the parameter is in that particular interval. CIs also give information about how precise the estimates are. Comparison…

The Journal of Agricultural Education (JAE) requires authors to follow the guidelines stated in the Publication Manual of the American Psychological Association [APA] (2009) in preparing research manuscripts, and to utilize accepted research and statistical methods in conducting quantitative research studies. The APA recommends the reporting of…

REL Southwest received a request to review the report "Avoidable Losses: High Stakes Accountability and the Dropout Crisis" to assess the soundness of the study methodology and the appropriateness of the conclusions drawn in the report. The review found that conclusions drawn in this study cannot be generalized and are significantly…

Written by a social worker for social work students, this is a nuts and bolts guide to statistics that presents complex calculations and concepts in clear, easy-to-understand language. It includes numerous examples, data sets, and issues that students will encounter in social work practice. The first section introduces basic concepts and terms to…