Educational researchers advocate the use of an effect size and its confidence interval to assess the effectiveness of interventions instead of relying on a p-value, which has been blamed for lack of reproducibility of research findings and the misuse of statistics. The aim of this study is to provide a framework, which can provide direct evidence…

This article is motivated by the importance of developing statistically literate students. The authors present a selection of problems that could be used to motivate student interest in probability as well as providing additional depth to the curriculum when used alongside traditional resources. The solutions presented utilise natural frequencies…

Multiple choice results are inherently probabilistic outcomes, as correct responses reflect a combination of knowledge and guessing, while incorrect responses additionally reflect blunder, a confidently committed mistake. To objectively resolve knowledge from responses in an MC test structure, we evaluated probabilistic models that explicitly…

This mixed research aims to design and implement the Web Application on Bayes' Theorem (WABT) in the Statistical Instrumentation for Business subject. WABT presents the procedure to calculate the probability of Bayes' Theorem through the simulation of data about the supply of products. Technology Acceptance Model (TAM), machine learning and data…

This article presents a latent class model for multilevel data to identify latent subgroups and estimate heterogeneous treatment effects. Unlike sequential approaches that partition data first and then estimate average treatment effects (ATEs) within classes, we employ a Bayesian procedure to jointly estimate mixing probability, selection, and…

The Schwarz or Bayesian information criterion (BIC) is one of the most widely used tools for model comparison in social science research. The BIC, however, is not suitable for evaluating models with order constraints on the parameters of interest. This article explores two extensions of the BIC for evaluating order-constrained models, one where a…

The present study compares the fit of two- and three-parameter logistic (2PL and 3PL) models of item response theory in the performance of preschool children on the Raven's Colored Progressive Matrices. The test of Raven is widely used for evaluating nonverbal intelligence of factor g. Studies comparing models with real data are scarce on the…

Educational resources can be easily found on the Web. Most search engines base their algorithms on a resource's text or popularity, requiring teachers to navigate the results until they find an appropriate resource. This makes searching for resources a tedious and cumbersome task. Specialized repositories contain resources that are annotated with…

Teaching some concepts in statistics greatly benefits from individual practice with immediate feedback. In order to provide such practice to a large number of students we have written a simulator based on an historical event: the loss in May 22, 1968, and subsequent search for the nuclear submarine USS Scorpion. Students work on a simplified…

Current developments in the statistics community suggest that modern statistics education should be structured holistically, that is, by allowing students to work with real data and to answer concrete statistical questions, but also by educating them about alternative frameworks, such as Bayesian inference. In this article, we describe how we…

Educational stakeholders are keen to know the magnitude and importance of different interventions. However, the way evidence is communicated to support understanding of the effectiveness of an intervention is controversial. Typically studies in education have used the standardised mean difference as a measure of the impact of interventions. This…

In 2015, the Australian Government's Excellence in Research for Australia (ERA) assessment of research quality declined to rate 1.5 per cent of submissions from universities. The public debate focused on practices of gaming or "coding errors" within university submissions as the reason for this outcome. The issue was about the…

Studies of psychological distress (PD) in university students have shown that they have high prevalence rates. These findings have raised concerns that PD may be leading to poorer student outcomes, such as elevated dropout rates. The aim of this study was to examine the association of PD in undergraduate university students with the competing…

One of the major debates concerning the nature of inferential reasoning is between counterexample-based theories such as mental model theory and probabilistic theories. This study looks at conclusion updating after the addition of statistical information to examine the hypothesis that deductive reasoning cannot be explained by probabilistic…

What factors best explain the low incidence of skills training in a late industrial society like Russia? This research undertakes a multilevel analysis of the role of occupational structure in the probability of training. The explanatory power of occupation-specific determinants and skills polarization are evaluated, using a representative 2012…