Publication Date
| In 2025 | 0 |
| Since 2024 | 0 |
| Since 2021 (last 5 years) | 0 |
| Since 2016 (last 10 years) | 0 |
| Since 2006 (last 20 years) | 4 |
Descriptor
| Evaluation Methods | 5 |
| Measurement Techniques | 5 |
| Statistical Inference | 5 |
| Statistical Significance | 5 |
| Evaluation Problems | 3 |
| Experiments | 3 |
| Hypothesis Testing | 3 |
| Misconceptions | 3 |
| Probability | 3 |
| Replication (Evaluation) | 3 |
| Research Methodology | 3 |
| More ▼ | |
Author
| Cumming, Geoff | 1 |
| Daniel, Larry G. | 1 |
| Gabriel, Stephanie | 1 |
| Maraun, Michael | 1 |
| Onwuegbuzie, Anthony J. | 1 |
| Overall, John E. | 1 |
| Roberts, J. Kyle | 1 |
| Serlin, Ronald C. | 1 |
| Tonidandel, Scott | 1 |
Publication Type
| Journal Articles | 5 |
| Reports - Evaluative | 2 |
| Reports - Research | 2 |
| Opinion Papers | 1 |
Education Level
Audience
Location
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Direct linkMaraun, Michael; Gabriel, Stephanie – Psychological Methods, 2010
In his article, "An Alternative to Null-Hypothesis Significance Tests," Killeen (2005) urged the discipline to abandon the practice of "p[subscript obs]"-based null hypothesis testing and to quantify the signal-to-noise characteristics of experimental outcomes with replication probabilities. He described the coefficient that he…
Descriptors: Hypothesis Testing, Statistical Inference, Probability, Statistical Significance
Overall, John E.; Tonidandel, Scott – Multivariate Behavioral Research, 2010
A previous Monte Carlo study examined the relative powers of several simple and more complex procedures for testing the significance of difference in mean rates of change in a controlled, longitudinal, treatment evaluation study. Results revealed that the relative powers depended on the correlation structure of the simulated repeated measurements.…
Descriptors: Monte Carlo Methods, Statistical Significance, Correlation, Depression (Psychology)
Serlin, Ronald C. – Psychological Methods, 2010
The sense that replicability is an important aspect of empirical science led Killeen (2005a) to define "p[subscript rep]," the probability that a replication will result in an outcome in the same direction as that found in a current experiment. Since then, several authors have praised and criticized 'p[subscript rep]," culminating…
Descriptors: Epistemology, Effect Size, Replication (Evaluation), Measurement Techniques
Cumming, Geoff – Psychological Methods, 2010
This comment offers three descriptions of "p[subscript rep]" that start with a frequentist account of confidence intervals, draw on R. A. Fisher's fiducial argument, and do not make Bayesian assumptions. Links are described among "p[subscript rep]," "p" values, and the probability a confidence interval will capture…
Descriptors: Replication (Evaluation), Measurement Techniques, Research Methodology, Validity
Peer reviewedOnwuegbuzie, Anthony J.; Roberts, J. Kyle; Daniel, Larry G. – Measurement and Evaluation in Counseling and Development, 2005
In this article, the authors (a) illustrate how displaying disattenuated correlation coefficients alongside their unadjusted counterparts will allow researchers to assess the impact of unreliability on bivariate relationships and (b) demonstrate how a proposed new "what if reliability" analysis can complement null hypothesis significance…
Descriptors: Correlation, Statistical Significance, Reliability, Error of Measurement
