Have a personal or library account? Click to login
Statistical significance does not imply a real effect Cover

Statistical significance does not imply a real effect

Open Access
|Mar 2016

Figures & Tables

Table 1

Scenario A (n = 64 per condition) and scenario B (n = 11 per condition) in terms of expected proportions of Type I error prevalence in a pile of statistically significant outcomes.

Scenario

A (n = 64)

B (n = 11)

Expected rejections of the 20 true null hypotheses

1

1

Expected rejections of the 80 untrue null hypotheses

64

16

Expected proportion of Type I errors in the pile of statistically significant results

1/65 (≈ 0.015)

1/17 (≈ 0.059)

Language: English
Published on: Mar 16, 2016
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2016 Jimmie Leppink, Kal Winston, Patricia O’Sullivan, published by Bohn Stafleu van Loghum
This work is licensed under the Creative Commons Attribution 4.0 License.