Have a personal or library account? Click to login
A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research Cover

A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research

Open Access
|Jan 2025

Abstract

Performing hypothesis tests with adequate statistical power is indispensable for psychological research. In response to several large-scale replication projects following the replication crisis, concerns about the root causes of this crisis – such as questionable research practices (QRPs) – have grown. While initial efforts primarily addressed the inflation of the type I error rate of research due to QRPs, recent attention has shifted to the adverse consequences of low statistical power. In this paper we first argue how underpowered studies, in combination with publication bias, contribute to a literature rife with false positive results and overestimated effect sizes. We then examine whether the prevalence of power analyses in psychological research has effectively increased over time in response to the increased awareness regarding these phenomena. To address this, we conducted a systematic review of 903 published empirical articles across four APA-disciplines, comparing 453 papers published in 2015–2016, with 450 papers from 2020–2021. Although the prevalence of power analysis across different domains in psychology has increased over time (from 9.5% to 30%), it remains insufficient overall. We conclude by discussing the implications of these findings and elaborating on some alternative methods to a priori power analysis that can help ensure sufficient statistical power.

DOI: https://doi.org/10.5334/pb.1318 | Journal eISSN: 0033-2879
Language: English
Submitted on: Mar 29, 2024
Accepted on: Dec 16, 2024
Published on: Jan 9, 2025
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2025 Lara Vankelecom, Ole Schacht, Nathan Laroy, Tom Loeys, Beatrijs Moerkerke, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.