Practitioners and policymakers often want estimates of the effect of an intervention for their local community, e.g., region, state, county. In the ideal, these multiple population average treatment effect (ATE) estimates will be considered in the design of a single randomized trial. Methods for sample selection for generalizing the sample ATE to…

With many pretreatment covariates and treatment factors, the classical factorial experiment often fails to balance covariates across multiple factorial effects simultaneously. Therefore, it is intuitive to restrict the randomization of the treatment factors to satisfy certain covariate balance criteria, possibly conforming to the tiers of…

In this study, we re-analyze recent empirical research on replication from a meta-analytic perspective. We argue that there are different ways to define "replication failure," and that analyses can focus on exploring variation among replication studies or assess whether their results contradict the findings of the original study. We…

The aim of this study was to examine the methodological tendencies in the doctorate theses which were prepared in the field of Sports Management in Turkish between 2007 and 2016 and which were open to access in the database of the Council of Higher Education (CHE) National Theses Center. In this context, 111 doctorate theses prepared in the last…

Although immediacy is one of the necessary criteria to show strong evidence of a causal relation in SCDs, no inferential statistical tool is currently used to demonstrate it. We propose a Bayesian unknown change-point model to investigate and quantify immediacy in SCD analysis. Unlike visual analysis that considers only 3-5 observations in…

The purpose of this study was to examine the postgraduate theses that focused on history textbooks between 1989 and 2017 in Turkey. The population was composed of 126 postgraduate theses (master's and doctoral) which were obtained from Thesis Center of Higher Education Council (HEC), Republic of Turkey. The document review method was used to…

Looking times (LTs) are frequently measured in empirical research on infant cognition. We analyzed the statistical distribution of LTs across participants to develop recommendations for their treatment in infancy research. Our analyses focused on a common within-subject experimental design, in which longer looking to novel or unexpected stimuli is…

Over the past two decades there have been major developments in deaf education in many countries. Medical and technical advances have made it possible for more deaf children to hear and speak successfully. Most deaf pupils learn in ordinary classes in mainstream schools. In this article we explore patterns of achievements of deaf pupils to see if…

Past research have pointed out that excellent strategies have been written but extremely small have been accomplished in their implementation. It has additionally been proposed that only 10% of formulated strategies are successfully implemented. However, crafting the best strategy is not the end in itself but the ultimate result will only be…

Single case designs are a set of research methods for evaluating treatment effects by assigning different treatments to the same individual and measuring outcomes over time and are used across fields such as behavior analysis, clinical psychology, special education, and medicine. Emerging standards for single case designs have focused attention on…

This conference presentation reviews the authors' work on autocorrelations in single-case designs. The bias-corrected autocorrelation is computed, results are meta-analyzed with 5-level multilevel analysis in SAS Proc Mixed. Results suggest autocorrelations are normally distributed, and that taking into account nesting in outcomes and articles…

Null distributions of permutation tests for two-sample, paired, and block designs are simulated using the R statistical programming language. For each design and type of data, permutation tests are compared with standard normal-theory and nonparametric tests. These examples (often using real data) provide for classroom discussion use of metrics…

This study uses Monte Carlo simulations to demonstrate that regression-discontinuity designs arrive at biased estimates when attributes related to outcomes predict heaping in the running variable. After showing that our usual diagnostics are poorly suited to identifying this type of problem, we provide alternatives. We also demonstrate how the…

The 2011 NAEP-TIMSS linking study conducted by the National Center for Education Statistics (NCES) was designed to predict Trends in International Mathematics and Science Study (TIMSS) scores for the U.S. states that participated in 2011 National Assessment of Educational Progress (NAEP) mathematics and science assessment of eighth-grade students.…

Effective policymaking requires understanding the causal effects of competing proposals. Relevant causal quantities include proposals' expected effect on different groups of recipients, the impact of policies over time, the potential trade-offs between competing objectives, and, ultimately, the optimal policy. This dissertation studies causal…