Search bioRxiv⌕ Search

Biology subjects

Lakens, D.

Publications and source records attributed to Lakens, D..

2 recordsLinked to original sources

Career incentives make Registered Reports unattractive under realistic academic conditions

Registered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing publish or perish culture. But would researchers always prefer such a low-risk option? When strong results allow publication in prestigious journals, the results-dependent nature of standard publications can actually be an advantage for authors. Given this trade-off, the choice between publication formats represents decision making under risk, and researchers may not always be risk-averse. To better understand under which circumstances Registered Reports are likely to be popular, we draw on risk-sensitivity theory from behavioural ecology and develop an agent-based model that explores how four factors shape publication strategies: whether additional publications yield diminishing or increasing career returns, the pace at which studies are completed, publication targets, and competition. We find that many realistic configurations lead researchers to avoid Registered Reports, even when Registered Reports are nearly as valuable as the best possible standard publication. Intense competition and low empirical pace can make the format unviable, while high empirical pace attenuates most other effects. Given prevailing career incentives in many fields, these results suggest that the market share of Registered Reports may remain trivially low without additional incentives or interventions.

scientific communication and education↗

Statistical power of clinical trials has increased whilst effect size remained stable: an empirical analysis of 137 032 clinical trials between 1975-2017

BackgroundBiomedical studies with low statistical power are a major concern in the scientific community and are one of the underlying reasons for the reproducibility crisis in science. If randomized clinical trials, which are considered the backbone of evidence-based medicine, also suffer from low power, this could affect medical practice.\n\nMethodsWe analysed the statistical power in 137 032 clinical trials between 1975 and 2017 extracted from meta-analyses from the Cochrane database of systematic reviews. We determined study power to detect standardized effect sizes according to Cohen, and in meta-analysis with p-value below 0.05 we based power on the meta-analysed effect size. Average power, effect size and temporal patterns were examined.\n\nResultsThe number of trials with power [≥]80% was low but increased over time: from 9% in 1975-1979 to 15% in 2010-2014. This increase was mainly due to increasing sample sizes, whilst effect sizes remained stable with a median Cohens h of 0.21 (IQR 0.12-0.36) and a median Cohens d of 0.31 (0.19-0.51). The proportion of trials with power of at least 80% to detect a standardized effect size of 0.2 (small), 0.5 (moderate) and 0.8 (large) was 7%, 48% and 81%, respectively.\n\nConclusionsThis study demonstrates that sufficient power in clinical trials is still problematic, although the situation is slowly improving. Our data encourages further efforts to increase statistical power in clinical trials to guarantee rigorous and reproducible evidence-based medicine.

epidemiology↗