Evidence for HARKing in mouse behavioural tests of anxiety

Abstract

Anxiety disorders are among the most common mental health conditions needing new and better treatments. Research and development of anxiolytic drugs using animal models heavily rely on behavioural tests, most of which measure anxiolytic effects by increased exploratory activity in potentially threatening environments. However, interpretation of such tests is ambiguous because reduced exploratory activity can reflect either anxiety or sedation by the compound. Based on a systematic review of the sensitivity of mouse behavioural tests of anxiety to anxiolytic drugs, we analysed outcomes of 206 studies testing the effect of diazepam in either the open-field test or the hole-board test, as outcomes of these tests showed substantial variation in both direction and strength of the drug effect. Surprisingly, we found that both the rationale given for using the test, whether to detect anxiolytic or sedative effects, and the predicted effect of diazepam, anxiolytic or sedative, strongly depended on the reported test results. The most likely explanation for such strong dependency is post-hoc reasoning, also called hypothesizing after the results are known (HARKing). HARKing can invalidate study outcomes and hampers evidence synthesis by inflating effect sizes. It may also lead researchers into blind alleys, put patients in clinical trials at risk, and waste animals, time, and resources for inconclusive research.