Search bioRxiv⌕ Search

bioRxiv · 10.1101/2020.03.19.998336

Evaluating institutional open access performance: Methodology, challenges and assessment

Abstract

Open Access to research outputs is becoming rapidly more important to the global research community and society. Changes are driven by funder mandates, institutional policy, grass-roots advocacy and culture change. It has been challenging to provide a robust, transparent and updateable analysis of progress towards open access that can inform these interventions, particularly at the institutional level. Here we propose a minimum reporting standard and present a large-scale analysis of open access progress across 1,207 institutions world-wide that shows substantial progress being made. The analysis detects responses that coincide with policy and funding interventions. Among the striking results are the high performance of Latin American and African universities, particularly for gold open access, whereas overall open access levels in Europe and North America are driven by repository-mediated access. We present a top-100 of global universities with the worlds leading institutions achieving around 80% open access for 2017 publications.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Huang, C.-K., Neylon, C., Hosking, R., Montgomery, L., Wilson, K., Ozaygen, A., Brookes-Kenworthy, C.. 2020-03-21. Evaluating institutional open access performance: Methodology, challenges and assessment. https://doi.org/10.1101/2020.03.19.998336

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

Long-term innovative potential of genetic research and its suppression

Long-term innovation depends not only on discovering new elements but also on facilitating new recombination at the time of their co-availability. This notion of combinatorial innovation raises the question about whether scientific exploration and industry research persist over similar time horizons to meet innovative opportunities. Here, we analyze about 20 million papers and US, Chinese, and European patents to compare the courses of scientific and industrial activities in genetic research, a domain of far-reaching societal importance. We observe that research on new genes has declined since the early 2000s, but the exploration of novel gene combinations remains active for biotechnology innovation. Yet, fields of highly practical or commercial focus are less likely to test novel gene combinations. Furthermore, industry R&D on each gene tends to decline earlier than scientific interest in that gene. After this decline of the industrial momentum, continuous scientific research still sustains exploratory and innovative opportunities, involving novel gene combinations, clinical trials, and technologically-impactful work. Based on a hypothetical scenario of over-aligned science and industry, we estimate that up to 42.2-74.4% of the combinational opportunities would be unexplored if scientific research becomes hindered due to industrys retreat. This study suggests the potential complementary roles of scientific and industrial research with different temporal modes in innovation cycles, calling for balanced policies to foster innovation ecosystems.

scientific communication and education↗

YAbS: The Antibody Society's antibody therapeutics database

Therapeutic antibodies have gained prominence in recent years due to their precision in targeting specific diseases. As these molecules become increasingly essential in modern medicine, comprehensive data tracking and analysis are critical for advancing research and ensuring successful clinical outcomes. YAbS, The Antibody Societys Antibody Therapeutics Database, serves as a vital resource for monitoring the development and clinical progress of therapeutic antibodies. The database catalogues detailed information on over 2,900 commercially sponsored investigational antibody candidates that have entered clinical study since 2000, as well as all approved antibody therapeutics. Data for the late-stage clinical pipeline and antibody therapeutics in regulatory review or approved (over 450 molecules) are openly accessible (https://db.antibodysociety.org). Antibody-related information includes molecular format, targeted antigen, current development status, indications studied, and the clinical development timeline of the antibodies, as well as the geographical region of company sponsors. Furthermore, the database supports in-depth industry trends analysis, facilitating the identification of innovative developments and the assessment of success rates within the field. This resource is continually updated and refined, providing invaluable insights to researchers, clinicians, and industry professionals engaged in antibody therapeutics development.

scientific communication and education↗