References
- Bakker M. van Dijk A. Wicherts J. M. The rules of the game called psychological science Perspectives on Psychological Science 2012 7 543 554 10.1177/1745691612459060
- Bakker M. Wicherts J. M. The (mis)reporting of statistical results in psychology journals Behavior Research Methods 2011 43 666 678 10.3758/s13428-011-0089-5
- Bargh J. A. Chen M. Burrows L. Automaticity of social behavior: Direct effects of trait construct and stereotype activation on action Journal of Personality and Social Psychology 1996 71 230 244 10.1037/0022-3514.71.2.230
- Baumeister R. F. Bratslavsky E. Muraven M. Tice D. M. Ego depletion: Is the active self a limited resource? Journal of Personality and Social Psychology 1998 74 1252 1265 10.1037/0022-3514.74.5.1252
-
Bem
D. J.
Zanna
M. P.
Darley
J. M.
Roediger
H. L.
III Writing the empirical journal article The compleat academic: A career guide 2003 2nd ed. Washington, D.C. American Psychological Association 185 219 - Bem D. J. Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect Journal of Personality and Social Psychology 2011 100 407 425 10.1037/a0021524
- Branch M. Malignant side effects of null-hypothesis significance testing Theory & Psychology 2014 24 256 277 10.1177/0959354314525282
-
Brewer
M. B.
Crano
W. D.
Reis
H. T.
Judd
C. M.
Research design and issues of validity Handbook of research methods in social and personality psychology 2014 New York Cambridge University Press 11 26 - Chalmers A. F. What is this thing called science?: An assessment of the nature and status of science and its methods 1982 2nd ed. St. Lucia University of Queensland Press
- Cohen J. The statistical power of abnormal-social psychological research: A review Journal of Abnormal and Social Psychology 1962 65 145 153 10.1037/h0045186
-
Cohen
J.
Wolman
B. B.
Some statistical issues in psychological research Handbook of clinical psychology 1965 New York McGraw-Hill 95 121 - Cohen J. Things I have learned (so far) American Psychologist 1990 45 1304 1312 10.1037/0003-066X.45.12.1304
- Cohen J. A power primer Psychological Bulletin 1992 112 155 159 10.1037/0033-2909.112.1.155
- Cohen J. The earth is round (p < .05) American Psychologist 1994 49 997 1003 10.1037/0003-066X.49.12.997
- Cooper M. L. Editorial Journal of Personality and Social Psychology 2016 110 431 434 10.1037/pspp0000033
- Coulson M. Healey M. Fidler F. Cumming G. Confidence intervals permit, but do not guarantee, better inference than statistical significance testing Frontiers in Psychology 2010 1 26 1 9 10.3389/fpsyg.2010.00026
- Crocker J. Cooper M. L. Addressing scientific fraud Science 2011 334 1182 10.1126/science.1216775
- Cumming G. Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis 2012 New York Routledge
- Cumming G. The new statistics: Why and how Psychological Science 2014 25 7 29 10.1177/0956797613504966
- Dienes Z. Understanding psychology as a science: An introduction to scientific and statistical inference 2008 New York Palgrave Macmillan
- Dienes Z. Bayesian versus orthodox statistics: Which side are you on? Perspectives on Psychological Science 2011 6 274 290 10.1177/1745691611406920
- Dienes Z. How Bayes factors change scientific practice Journal of Mathematical Psychology 2016 78 78 89 10.1016/j.jmp.2015.10.003
- Doyen S. Klein O. Pichon C.-L. Cleeremans A. Behavioral priming: It’s all in the mind, but whose mind? PLOS One 2012 7 e29081 10.1371/journal.pone.0029081
- Etz A. Vandekerckhove J. A Bayesian Perspective on the Reproducibility Project: Psychology PLOS ONE 2016 11 2 e0149794 10.1371/journal.pone.0149794
- Fanelli D. Negative results are disappearing from most disciplines and countries Scientometrics 2012 90 891 904 10.1007/s11192-011-0494-7
- Faul F. Erdfelder E. Lang A.-G. Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences Behavior Research Methods 2007 39 175 191 10.3758/BF03193146
- Ferguson C. J. Heene M. A vast graveyard of undead theories: Publication bias and psychological science’s aversion to the null Perspectives on Psychological Science 2012 7 555 561 10.1177/1745691612459059
- Fischhoff B. Hindsight is not equal to foresight: The effect of outcome knowledge on judgment under uncertainty Journal of Experimental Psychology: Human Perception and Performance 1975 1 3 288 299 10.1037/0096-1523.1.3.288
- Fiske S. T. Mind the gap: In praise of informal sources of formal theory Personality and Social Psychology Review 2004 8 2 132 137 10.1207/s15327957pspr0802_6
- Forstmeier W. Wagenmakers E.-J. Parker T. H. Detecting and avoiding likely false positive findings – a practical guide Biological Reviews 2016 10.1111/brv.12315
- Francis G. The psychology of replication and replication in psychology Perspectives on Psychological Science 2012 7 6 585 594 10.1177/1745691612459520
- Galak J. LeBoeuf R. A. Nelson L. D. Simmons J. P. Correcting the past: Failures to replicate psi Journal of Personality and Social Psychology 2012 103 933 948 10.1037/a0029709
- Gallistel C. R. The importance of proving the null Psychological Review 2009 116 439 453 10.1037/a0015251
- Garfield E. The history and meaning of the journal impact factor Journal of the American Medical Association 2006 295 1 90 93 10.1001/jama.295.1.90
- Gergen K. J. Social psychology as history Journal of Personality and Social Psychology 1973 26 2 309 320 10.1037/h0034436
- Gigerenzer G. Mindless statistics Journal of Socio-Economics 2004 33 587 606 10.1016/j.socec.2004.09.033
-
Gigerenzer
G.
Krauss
S.
Vitouch
Kaplan
D.
The null ritual: What you always wanted to know about significance testing but were afraid to ask The Sage handbook of quantitative methodology for the social sciences 2004 Thousand Oaks, CA Sage 391 408 - Gigerenzer G. Marewski J. N. Surrogate science: The idol of a universal method for scientific inference Journal of Management 2015 41 421 440 10.1177/0149206314547522
- Giner-Sorolla R. Science or art?: How aesthetic standards grease the way through the publication bottleneck but undermine science Perspectives on Psychological Science 2012 7 562 571 10.1177/1745691612457576
- Hagger M. S. Chatzisarantis N. L. D. Alberts H. Anggono C. O. Batailler C. Birt A. R. Zwienenberg M. A multilab preregistered replication of the ego-depletion effect Perspectives on Psychological Science 2016 11 546 573 10.1177/1745691616652873
- Hoekstra R. Finch S. Kiers H. A. Johnson A. Probability as certainty: Dichotomous thinking and the misuse of p values Psychonomic Bulletin & Review 2006 13 1033 1037 10.3758/BF03213921
- Hofstede G. H. Hofstede G. Culture’s consequences: Comparing values, behaviors, institutions and organizations across nations 2001 Thousand Oaks, CA Sage
- Inbar Y. The association between “contextual dependence” and replicability in psychology may be spurious Proceedings of the National Academy of Sciences of the United States of America 2016 113 34 E4933 E4934 10.1073/pnas.1608676113
- Ioannidis J. P. A. Why most published research findings are false PLOS Medicine 2005 2 8 e124 10.1371/journal.pmed.0020124
- John L. K. Loewenstein G. Prelec D. Measuring the prevalence of questionable research practices with incentives for truth telling Psychological Science 2012 23 524 532 10.1177/0956797611430953
- Johnson V. E. Revised standards for statistical evidence Proceedings of the National Academy of Sciences 2013 110 19313 19317 10.1073/pnas.1313476110
- Jost J. T. Banaji M. R. Prentice D. A. Perspectivism in social psychology: The yin and yang of scientific progress 2004 Washington, D.C. American Psychological Association 10.1037/10750-000
- Jost J. T. Kruglanski A. W. The enstrangement of social constructionism and experimental social psychology: History of the rift and prospects of reconciliation Personality and Social Psychology Review 2002 6 3 168 187 10.1207/S15327957PSPR0603_1
- Judd C. M. Gawronski B. Editorial comment Journal of Personality and Social Psychology 2011 100 3 406 10.1037/0022789
- Keppel G. Design and analysis: A researcher’s handbook 1991 3rd ed. Upper Saddle River, NJ Prentice Hall
- Kerr N. L. HARKing: Hypothesizing after the results are known Personality and Social Psychology Review 1998 2 196 217 10.1207/s15327957pspr0203_4
- Klein O. Doyen S. Leys C. Magalhães de Saldanha da Gama Miller S. Questienne L. Cleeremens A. Low hopes, high expectations: Expentancy effects and replicability of behavioral experiments Perspectives on Psychological Science 2012 7 6 572 584 10.1177/1745691612463704
- Kuhn T. S. The structure of scientific revolutions 1962 Chicago University of Chicago Press
- Lakatos I. The methodology of scientific research programmes 1978 London and New York Cambridge University Press 10.1017/CBO9780511621123
- Lakens D. Evers E. R. K. Sailing from the seas of chaos into the corridor of stability: Practical recommendations to increase the informational value of studies Perspectives on Psychological Science 2014 9 278 292 10.1177/1745691614528520
- Loken E. Gelman A. Measurement error and the replication crisis Science 2017 355 6325 584 585 10.1126/science.aal3618
- Makel M. C. Plucker J. A. Hegarty B. Replications in psychology research: How often do they really occur? Perspectives on Psychological Science 2012 7 537 542 10.1177/1745691612460688
- Markus H. R. Kitayama S. Culture and the self: Implications for cognition, emotion, and motivation Psychological Review 1991 92 224 253 10.1037/0033-295X.98.2.224
- Maxwell S. E. The persistence of underpowered studies in psychological research: Causes, consequences, and remedies Psychological Methods 2004 9 147 163 10.1037/1082-989X.9.2.147
- Maxwell S. E. Kelley K. Rausch J. R. Sample size planning for statistical power and accuracy in parameter estimation Annual Review of Psychology 2008 59 537 563 10.1146/annurev.psych.59.103006.093735
-
McGuire
W. J.
Berkowitz
L.
A contextualist theory of knowledge: Its implications for innovation and reform in psychological research Advances in experimental social psychology 1983 Orlando, FL Academic Press 16 1 47 10.1016/s0065-2601(08)60393-7 -
McGuire
W. J.
Gholson
B.
Shadish
W. R.
Jr. Neimeyer R. A. Houts A. C.A perspectivist approach to the strategic planning of programmatic scientific research Psychology of science: Contribution to metascience 1989 New York Cambridge University Press 214 245 10.1017/CBO9781139173667.012 - McGuire W. J. Creative hypothesis generating in psychology: Some useful heuristics Annual Review of Psychology 1997 48 1 30 10.1146/annurev.psych.48.1.1
- McGuire W. J. Constructing social psychology: Creative and critical processes 1999 Cambridge Cambridge University Press 10.1017/CBO9780511571206
- McGuire W. J. A perspectivist approach to theory construction Personality and Social Psychology Review 2004 8 173 182 10.1207/s15327957pspr0802_11
- Meehl P. E. Theory-testing in psychology and physics: A methodological paradox Philosophy of Science 1967 34 103 115 10.1086/288135
- Meehl P. E. Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology Journal of Consulting and Clinical Psychology 1978 46 806 834 10.1037/0022-006X.46.4.806
- Meehl P. E. Appraising and amending theories: The strategy of Lakatosian defense and two principles that warrant it Psychological Inquiry 1990 1 108 141 10.1207/s15327965pli0102_1
-
Meehl
P. E.
Harlow
L.
Mulaik
S. A.
Steiger
J. H.
The problem is epistemology, not statistics: Replace significance tests by confidence intervals and quantify accuracy of risky numerical predictions What if there were no significance tests? 1997 Mahwah, NJ Erlbaum 393 425 - Mulder J. Wagenmakers E.-J. Editors’ introduction to the special issue “Bayes factors for testing hypotheses in psychological research: Practical relevance and new developments” Journal of Mathematical Psychology 2016 72 1 5 10.1016/j.jmp.2016.01.002
- Neuliep J. W. Crandall R. Reviewer bias against replication research Journal of Social Behavior and Personality 1993 8 21 29
- Nisbett R. E. Peng K. Choi I. Norenzayan A. Culture and systems of thought: Holistic versus analytic cognition Psychological Review 2001 108 291 310 10.1037//0033-295X.108.2.291
- Norenzayan A. Heine S. J. Psychological universals: What are they and how can we know? Psychological Bulletin 2005 131 5 763 784 10.1037/0033-2909.131.5.763
- Nosek B. A. Spies J. R. Motyl M. Scientific utopia II: Restructuring incentives and practices to promote truth over publishability Perspectives on Psychological Science 2012 7 615 631 10.1177/1745691612459058
- Nuijten M. B. Hartgerink C. H. J. van Assen M. A. L. M. Epskamp S. Wicherts J. M. The prevalence of statistical reporting errors in psychology (1985–2013) Behavior Research Methods 2015 48 1205 1226 10.3758/s13428-015-0664-2
- Open Science Collaboration An open, large-scale, collaborative effort to estimate the reproducibility of psychological science Perspectives on Psychological Science 2012 7 6 657 660 10.1177/1745691612462588
- Open Science Collaboration Estimating the reproducibility of psychological science Science 2015 349 aac4716 10.1126/science.aac4716
- Pashler H. Wagenmakers E.-J. Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science 2012 7 528 530 10.1177/1745691612465253
- Popper K. R. The logic of scientific discovery 1959 London Hutchinson
-
Richard
F. D.
Bond
C. F.
Jr. Stokes-Zoota J. J. One hundred years of social psychology quantitatively described Review of General Psychology 2003 7 331 363 10.1037/1089-2680.7.4.331 - Rogers J. L. Howard K. I. Vessey J. T. Using significance tests to evaluate equivalence between two experimental groups Psychological Bulletin 1993 113 3 553 565 10.1037/0033-2909.113.3.553
- Rosenthal R. The file drawer problem and tolerance for null results Psychological Bulletin 1979 86 638 641 10.1037/0033-2909.86.3.638
- Rossi J. S. Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology 1990 58 646 656 10.1037/0022-006X.58.5.646
- Rouder J. N. Speckman P. L. Sun D. Morey R. D. Iverson G. Bayesian t-tests for accepting and rejecting the null hypothesis Psychonomic Bulletin & Review 2009 16 225 237 10.3758/PBR.16.2.225
- Schimmack U. The ironic effect of significant results on the credibility of multiple-study articles Psychological Methods 2012 17 551 566 10.1037/a0029487
- Schmidt S. Shall we really do it again?: The powerful concept of replication is neglected in the social sciences Review of General Psychology 2009 13 90 100 10.1037/a0015108
- Sears D. O. College sophomores in the laboratory: Influences of a narrow data base on social psychology’s view of human nature Journal of Personality and Social Psychology 1986 51 515 530 10.1037/0022-3514.51.3.515
- Sedlmeier P. Gigerenzer G. Do studies of statistical power have an effect on the power of studies? Psychological Bulletin 1989 105 309 316 10.1037/0033-2909.105.2.309
- Simmons J. P. Nelson L. D. Simonsohn U. False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant Psychological Science 2011 22 1359 1366 10.1177/0956797611417632
-
Stangor
C.
Lemay
E. P.
Jr. Introduction to the special issue on methodological rigor and replicability Journal of Experimental Social Psychology 2016 66 1 3 10.1016/j.jesp.2016.02.006 - Stukas A. A. Cumming G. Interpreting effect sizes: Toward a quantitative cumulative social psychology European Journal of Social Psychology 2014 44 711 722 10.1002/ejsp.2019
- Świątkowski W. On the use of subjective probabilities in data analysis: An introduction to Bayesian statistics for social psychology starters (submitted)
- Trafimow D. The theory of reasoned action: A case study of falsification in psychology Theory & Psychology 2009 19 4 501 518 10.1177/0959354309336319
- Trafimow D. Marks M. Editorial Basic and Applied Social Psychology 2015 37 1 1 2 10.1080/01973533.2015.1012991
- Tressoldi P. E. Replication unreliability in psychology: elusive phenomena or “elusive” statistical power? Frontiers in Psychology 2012 3 1 5 10.3389/fpsyg.2012.00218
- Van Bavel J. J. Mende-Siedlecki P. Brady W. J. Reinero D. A. Contextual sensitivity in scientific reproducibility Proceedings of the National Academy of Sciences 2016a 113 6454 6459 10.1073/pnas.1521897113
- Van Bavel J. J. Mende-Siedlecki P. Brady W. J. Reinero D. A. Reply to Inbar: Contextual sensitivity helps explain the reproducibility gap between social and cognitive psychology Proceedings of the National Academy of Sciences 2016b 113 E4935 E4936 10.1073/pnas.1609700113
- Wagenmakers E.-J. A practical solution to the pervasive problems of p values Psychonomic Bulletin & Review 2007 14 779 804 10.3758/BF03194105
- Wagenmakers E.-J. Wetzels R. Borsboom D. van der Maas H. Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011) Journal of Personality and Social Psychology 2011 100 426 432 10.1037/a0022790
- Wallach L. Wallach M. A. Some theories are unfalsifiable: A comment on Trafimow Theory & Psychology 2010 20 703 706 10.1177/0959354310373676
- Wasserstein R. L. Lazar N. A. The ASA’s statement on p-values: Context, process, and purpose The American Statistician 2016 70 129 133 10.1080/00031305.2016.1154108
- Wetzels R. Matzke D. Lee M. D. Rouder J. N. Iverson G. J. Wagenmakers E.-J. Statistical evidence in experimental psychology: An empirical comparison using 855 t-tests Perspectives on Psychological Science 2011 6 3 291 298 10.1177/1745691611406923