The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

There is a wealth of evidence that people's reasoning is influenced by explanatory considerations. Little is known, however, about the exact form this influence takes, for instance about whether the influence is unsystematic or because of people's following some rule. Three experiments investigate the descriptive adequacy of a precise proposal to…

The literature on factors that influence participation in qualitative research is lacking. We conducted an experiment with a nationally representative sample to test the impact of different incentive types and amounts on willingness to participate in a hypothetical qualitative interview. We randomized participants from an online panel to one of…

Heterogeneity in meta-analysis is most commonly estimated using a moment-based approach described by DerSimonian and Laird. However, this method has been shown to produce biased estimates. Alternative methods to estimate heterogeneity include the restricted maximum likelihood approach and those proposed by Paule and Mandel, Sidik and Jonkman, and…

In 1881, Donald MacAlister posed a problem in the "Educational Times" that remains relevant today. The problem centers on the statistical evidence for the effectiveness of a treatment based on a comparison between two proportions. A brief historical sketch is followed by a discussion of two default Bayesian solutions, one based on a…

The present longitudinal study addressed the ongoing debate regarding the benefits and risks of infant-parent cosleeping by examining associations between sleep arrangement patterns across the first year of life and infant and parent sleep, marital and family functioning, and quality of mothers' behavior with infants at bedtime. Patterns of infant…

In the literature, the potential efficacy of the gamification of education has been demonstrated. The aim of this study was to explore the influence of applying gamification techniques to increase student engagement in learning. The quasi-experimental nonequivalent-control group design was used with 577 undergraduate students from six classes. The…

Research Findings: This study used data from a national sample to examine differences in school outcomes at the end of kindergarten between Head Start children who attended full-day and half-day programs. Propensity scores were used to match children who experienced different intensities of the program on a series of demographic characteristics in…

We compared 5 different statistics (i.e., G index, gamma, "d'", sensitivity, specificity) used in the social sciences and medical diagnosis literatures to assess calibration accuracy in order to examine the relationship among them and to explore whether one statistic provided a best fitting general measure of accuracy. College…

This study examined the effectiveness of two methods of increasing student learning from posterior probability lessons: diagrams and questioning while reading. Undergraduate students (N = 245) read a lesson in one of three diagram conditions and one of three questioning-while-reading conditions (embedded questions, elaboration interrogations, and…

When pigeons are given a choice between two alternatives, one leading to a stimulus 20% of the time that always signals reinforcement (S+) or another stimulus 80% of the time that signals no reinforcement (S-), and the other alternative leading to one of two stimuli each signaling reinforcement 50% of the time, they show a strong preference for…

Often researchers face situations where comparative studies between two or more programs are necessary to make causal inferences for informed policy decision-making. Experimental designs employing randomization provide the strongest evidence for causal inferences. However, many pragmatic and ethical challenges may preclude the use of randomized…

Formal inference, which makes theoretical assumptions about distributions and applies hypothesis testing procedures with null and alternative hypotheses, is notoriously difficult for tertiary students to master. The debate about whether this content should appear in Years 11 and 12 of the "Australian Curriculum: Mathematics" has gone on…

The debate about whether making a risky choice is based on a weighting and adding process has a long history and is still unresolved. To address this long-standing controversy, we developed a comparative paradigm. Participants' eye movements in 2 risky choice tasks that required participants to choose between risky options in single-play and…

Problem-based learning has been proven to be successful in both medical colleges and physics classes, but not uniformly across all disciplines. A college course in probability and statistics was used as a setting to test the effectiveness of problem-based learning when applied to homework. This paper compares the performances of the students from…