bioRxiv · 10.1101/2024.07.31.606048
What the Average Really Means: Dissociating Effect Size and Effect Prevalence using p-curve Mixtures
Abstract
Much research in the behavioral sciences aims to characterize the "typical" person. A statistically significant group-averaged effect size is often interpreted as evidence that the typical person shows an effect, but that is only true under certain distributional assumptions for which explicit evidence is rarely presented. Mean effect size varies with both within-participant effect size and population prevalence (proportion of population showing effect). Few studies consider how prevalence affects mean effect size estimates and existing estimators of prevalence are, conversely, confounded by uncertainty about effect size. We introduce a widely applicable Bayesian method, the p-curve mixture model, that jointly estimates prevalence and effect size by probabilistically clustering participant-level data based on their likelihood under a null distribution. Our approach, for which we provide a software tool, outperforms existing prevalence estimation methods when effect size is uncertain and is sensitive to differences in prevalence or effect size across groups or conditions.
Source connections
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Veillette, J. P., Nusbaum, H. C.. 2024-08-01. What the Average Really Means: Dissociating Effect Size and Effect Prevalence using p-curve Mixtures. https://doi.org/10.1101/2024.07.31.606048
Cite the original work for its findings. Save a collection to share your selection of sources.