This article presents two alternative methods to null hypothesis significance testing (NHST) for improving inferences from underpowered research designs. Post hoc design analysis (PHDA) assesses whether an NHST analysis generating null findings might otherwise have had sufficient power to detect effects of plausible magnitudes. Bayesian analysis…

Students often believe that statistical significance is the only determinant of whether a quantitative result is "important." In this paper, I review traditional null hypothesis statistical testing to identify what questions inferential statistics can and cannot answer, including statistical significance, effect size and direction,…

This comment discusses some issues about the use and reporting of experimental studies in education, illustrated by a recently published study that claimed (i) that an educational innovation was effective despite outcomes not reaching statistical significance, and (ii) that this refuted the findings of an earlier study. The two key issues raised…

The purpose of this quantitative non-experimental study is to determine the leadership competencies most desired by members of the community college board of trustees and faculty for a community college president. The study will examine the alignment of those competencies between the trustees and their faculty groups to determine if the two groups…

Recently, Stephen Gorard has outlined strong objections to the use of significance testing in social research. He has argued, first, that as the samples used in social research are almost always non-random it is not possible to use inferential statistical techniques and, second, that even if a truly random sample were achieved, the logic behind…

This monograph provides an epistemological rational for the design of a novel post hoc statistical measure called "Tri-Center Analysis". This new statistic is designed to analyze the post hoc outcomes of the Tri-Squared Test. In Tri-Center Analysis trichotomous parametric inferential parametric statistical measures are calculated from…

Current dissertation has been conducted in order to investigate and detect training needs of the mangers (top and middle) in Tehran Electricity Distribution Company. Research method is applied kind based on its purpose. Due to data collection method, this query is descriptive-survey type. Statistical population in this study is all of managers in…

Purpose: Four purposes were present in this journal-ready dissertation. The first purpose was to examine the degree to which the percentage of beginning teachers in traditionally configured elementary, middle, and secondary Texas schools differed as a function of two distinction designations (i.e., Academic Achievement in Reading/English Language…

Although it is assumed that increasing the institutionalization (or maturity) of project management in an organization leads to greater project success, the literature has diverse views. The purpose of this mixed methods study was to examine the correlation between project management maturity and IT/IS project outcomes. The sample consisted of two…

I discuss three common practices that obfuscate or invalidate the statistical analysis of randomized controlled interventions in applied linguistics. These are (a) checking whether randomization produced groups that are balanced on a number of possibly relevant covariates, (b) using repeated measures ANOVA to analyze pretest-posttest designs, and…

The goal of the current study is to explore the influence of knowledge on socioeconomic discrepancies in word learning and comprehension. After establishing socioeconomic differences in background knowledge (Study 1), the authors presented children with a storybook that incorporates this knowledge (Study 2). Results indicated that middle-income…

Many librarians use data from surveys to make decisions about how to spend money or allocate staff, often making use of popular online tools like Survey Monkey. In this era of reduced budgets, low staffing, stiff competition for new resources, and increasingly complex choices, it is especially important that librarians know how to get strong,…

The purpose of this study was to investigate differences between readers with different levels of comprehension skill when engaging in a causal questioning activity during reading, and the varied effects on inference generation. Fourth-grade readers (n = 74) with different levels of comprehension skill read narrative texts aloud and were asked…

Purpose: Researchers and scholars have called for greater attention to collaboration among and between educational leaders in districtwide reform. This work underlines the important social aspect of such collaboration and further investigates the type of professional interaction among/between district and school leaders particularly around the…

We surveyed researchers in the health and exercise sciences to explore different areas and magnitudes of bias in researchers' decision making. Participants were presented with scenarios (testing a central hypothesis with p = 0.06 or p = 0.04) in a random order and surveyed about what they would do in each scenario. Participants showed significant…