Gender and international diversity improves equity in peer review

Murray, D.; Siler, K.; Lariviere, V.; Chan, W. M.; Collings, A. M.; Raymond, J.; Sugimoto, C. R.

doi:10.1101/400515

Home/Archive/bioRxiv

bioRxiv · 10.1101/400515

Gender and international diversity improves equity in peer review

Murray, D.·Siler, K.·Lariviere, V.·Chan, W. M.·Collings, A. M.·Raymond, J.·Sugimoto, C. R.

View original source ↗Export metadata ↓

Abstract

The fairness of scholarly peer review has been challenged by evidence of disparities in publication outcomes based on author demographic characteristics. To assess this, we conducted an exploratory analysis of peer review outcomes of 23,876 initial submissions and 7,192 full submissions that were submitted to the biosciences journal eLife between 2012 and 2017. Women and authors from nations outside of North America and Europe were underrepresented both as gatekeepers (editors and peer reviewers) and authors. We found evidence of a homophilic relationship between the demographics of the gatekeepers and authors and the outcome of peer review; that is, there were higher rates of acceptance in the case of gender and country homophily. The acceptance rate for manuscripts with male last authors was seven percent, or 3.5 percentage points, greater than for female last authors (95% CI = [0.5, 6.4]); this gender inequity was greatest, at nine percent or about 4.8 percentage points (95% CI = [0.3, 9.1]), when the team of reviewers was all male; this difference was smaller and not significantly different for mixed-gender reviewer teams. Homogeny between countries of the gatekeeper and the corresponding author was also associated with higher acceptance rates for many countries. To test for the persistence of these effects after controlling for potentially confounding variables, we conducted a logistic regression including document and author metadata. Disparities in acceptance rates associated with gender and country of affiliation and the homophilic associations remained. We conclude with a discussion of mechanisms that could contribute to this effect, directions for future research, and policy implications. Code and anonymized data have been made available at https://github.com/murrayds/elife-analysis\n\nAuthor summaryPeer review, the primary method by which scientific work is evaluated, is ideally a fair and equitable process in which scientific work is judged solely on its own merit. However, the integrity of peer review has been called into question based on evidence that outcomes often differ between male and female authors, and for authors in different countries. We investigated such disparities at the biosciences journal eLife by analyzing the demographics of authors and gatekeepers (editors and peer reviewers), and peer review outcomes of all submissions between 2012 and 2017. Outcomes were more favorable for male authors and those affiliated with institutions in North America and Europe; these groups were also over-represented among gatekeepers. There was evidence that peer review outcomes were influenced by homophily --a preference of gatekeepers for manuscripts from authors with shared characteristics. We discuss mechanisms that could contribute to this effect, directions for future research, and policy implications.

Explore related subjects

scientific communication and education Preprint

Keep this discovery

BibTeX RIS

Murray, D., Siler, K., Lariviere, V., Chan, W. M., Collings, A. M., Raymond, J., Sugimoto, C. R.. 2018-08-29. Gender and international diversity improves equity in peer review. https://doi.org/10.1101/400515

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

bioRxiv2018

Fair allocation of healthcare research funds by the European Union?

This study aimed to investigate the distribution of European Union (EU) healthcare research grants across EU countries, and to study the effect of the potential influencing factors on grant allocation. We analysed publicly available data on healthcare research grants from the 7th Framework Programme and the Horizon 2020 Programme allocated to beneficiaries between 2007 and 2016. Grant allocation was analysed at the beneficiary-, country-, and country group-level (EU-15 versus newer Member States, defined as EU-13). The investigated country-level explanatory variables included GDP per capita, population size, overall disease burden, and healthcare research excellence. Grant amounts per 100,000 inhabitants was used as an outcome variable in the regression analyses.\n\nResearch funds were disproportionally allocated to EU-15 versus the EU-13, as 96.9% of total healthcare grants were assigned to EU-15 countries. At the beneficiary level, EU funding was positively influenced by participating in previous grants. The average grant amount per beneficiary was higher for EU-15 organizations. In univariate regression analyses at the country level, higher GDP per capita (p<0.001) and better medical research excellence (p<0.001) were associated with more EU funding, and a higher disease burden was associated with less EU funding (p=0.003). In the multiple regression analysis GDP per capita (p=0.002) and research excellence (p<0.001) had a significant positive association with EU funding. Population size had an inverted U-shaped relationship with EU funding for healthcare research, having the largest per capita funding in second and the third quartiles (p=0.03 and p=0.02).\n\nThe uneven allocation of healthcare research funds across EU countries was influenced by GDP per capita, medical research excellence and population size. Wealthier countries with an average population size and strong research excellence in healthcare had more EU funding for healthcare research. Higher disease burden apparently was not associated with more EU research funding.

scientific communication and education↗

bioRxiv2018

Authorship inflation and author gender in pulmonology research.

IntroductionHonorary authorship and equal gender representation are two pressing matters in scientific research. Honorary authorship is the inclusion of authors who do not meet the criteria established by the International Committee of Medical Journal Editors (ICMJE) authorship guidelines. The inclusion of honorary authors in the medical literature has led to an increase of the number of authors on studies and a decrease in single author studies in various fields.\n\nMethodsOur primary objective was to assess authorship trends in two major pulmonology journals (selected on the basis of Google Scholar rankings): Thorax and American Journal of Respiratory and Critical Care Medicine. We reviewed all articles published in both journals in the years 1994, 2004, and 2014 using Web of Science and extracted data such as number of authors and gender of the first and last authors.\n\nResultsThe total number of authors steadily increased from 1994 to 2014. The median number of authors grew from about four in 1994 to nearly seven in 2014, which is approximately a 75% increase. When we compiled all the data, we found the percentage of female authors from both journals had increased from 17% to 29.9% during the study period.\n\nDiscussionWe found an increase in the average number of authors on pulmonology publications between 1994 and 2014 as well as an increase in the number of females with a lead or main author position. This may be due to a variety of factors, such as increased team science. However, our data in conjunction with data from other areas of medicine, indicate that honorary authorship may be contributing to the trends we identified.

scientific communication and education↗