Search bioRxiv⌕ Search

bioRxiv · 10.1101/2021.01.19.427362

Alignment of biomedical data repositories with open, FAIR, citable and trustworthy principles

Abstract

Increasing attention is being paid to the operation of biomedical data repositories in light of efforts to improve how scientific data is handled and made available for the long term. Multiple groups have produced recommendations for functions that biomedical repositories should support, with many using requirements of the FAIR data principles as guidelines. However, FAIR is but one set of principles that has arisen out of the open science community. They are joined by principles governing open science, data citation and trustworthiness, all of which are important aspects for biomedical data repositories to support. Together, these define a framework for data repositories that we call OFCT: Open, FAIR, Citable and Trustworthy. Here we developed an instrument using the open source PolicyModels toolkit that attempts to operationalize key aspects of OFCT principles and piloted the instrument by evaluating eight biomedical community repositories listed by the NIDDK Information Network (dkNET.org). Repositories included both specialist repositories that focused on a particular data type or domain, in this case diabetes and metabolomics, and generalist repositories that accept all data types and domains. The goal of this work was both to obtain a sense of how much the design of current biomedical data repositories align with these principles and to augment the dkNET listing with additional information that may be important to investigators trying to choose a repository, e.g., does the repository fully support data citation? The evaluation was performed from March to November 2020 through inspection of documentation and interaction with the sites by the authors. Overall, although there was little explicit acknowledgement of any of the OFCT principles in our sample, the majority of repositories provided at least some support for their tenets.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Murphy, F., Bar-Sinai, M., Martone, M. E.. 2021-01-20. Alignment of biomedical data repositories with open, FAIR, citable and trustworthy principles. https://doi.org/10.1101/2021.01.19.427362

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

Children's Species Literacy as Estimated and Desired by Biodiversity Communicators: a Mismatch with the Actual Level

While biodiversity decline continues and laypeoples knowledge about species is limited, especially in children, high-quality communication is needed to raise awareness. For this, communicators should be aware of current knowledge levels in their target groups. We compared biodiversity communicators' estimates of the average species literacy level in primary school children with the actual level. Moreover, we explored the importance that communicators placed on species literacy and the level that they desired. Estimations of childrens average knowledge level varied widely and differed from the actual level. In particular, communicators overestimated the species literacy level. Although most biodiversity communicators agreed that knowledge about species is important, their view differed as to why species literacy would be important. Moreover, communicators differed with respect to the relative importance attached to different knowledge components. Professionals may thus benefit from a detailed framework of species literacy that illustrates different aspects and values. Most importantly, our findings suggest that to bridge the gap between actual and desired knowledge levels in children effectively, biodiversity communicators first need to become more aware of current perceptions in young audiences.

scientific communication and education↗

Gender Imbalance in the Editorial Activities of a Researcher-led Journal

Editorial decision-making is a fundamental element of the scientific enterprise. We examined whether contributions to editorial decisions at various stages of the publication process is subject to gender disparity, based on analytics collected by the biomedical researcher-led journal eLife. Despite efforts to increase women representation, the board of reviewing editors (BRE) was men-dominant (69%). Moreover, authors suggested more men from the BRE pool, even after correcting for mens numerical over-representation. Although women editors were proportionally involved in the initial editorial process, they were under-engaged in editorial activities involving reviewers and authors. Additionally, converging evidence showed gender homophily in manuscripts assignment, such that men Senior Editors over-engaged men Reviewing Editors. This tendency was stronger in more gender-balanced scientific disciplines. Together, our findings confirm that gender disparities exist along the editorial process and suggest that merely increasing the proportion of women might not be sufficient to eliminate this bias.

scientific communication and education↗