Search bioRxivSearch

bioRxiv · 10.1101/2020.06.22.165654

Advancing science or advancing careers? Researchers' opinions on success indicators

Abstract

The way in which we assess researchers has been under the radar in the past few years. Critics argue that current research assessments focus on productivity and that they increase unhealthy pressures on scientists. Yet, the precise ways in which assessments should change is still open for debate. We circulated a survey with Flemish researchers to understand how they work, and how they would rate the relevance of specific indicators used in research assessments. We found that most researchers worked far beyond their expected working schedule. We also found that, although they spent most of their time doing research, respondents wished they could dedicate more time to it and spend less time writing grants and performing other activities such as administrative duties and meetings. When looking at success indicators, we found that indicators related to openness, transparency, quality, and innovation were perceived as highly important in advancing science, but as relatively overlooked in career advancement. Conversely, indicators which denoted of prestige and competition were generally rated as important to career advancement, but irrelevant or even detrimental in advancing science. Open comments from respondents further revealed that, although indicators which indicate openness, transparency, and quality (e.g., publishing open access, publishing negative findings, sharing data, etc.) should ultimately be valued more in research assessments, the resources and support currently in place were insufficient to allow researchers to endorse such practices. In other words, current research assessments are inadequate and ignore practices which are essential in contributing to the advancement of science. Yet, before we change the way in which researchers are being assessed, supporting infrastructures must be put in place to ensure that researchers are able to commit to the activities that may benefit the advancement of science. Submission historyThe first version of this manuscript was submitted to PLOS ONE on 27th June 2020. Revisions after peer-review were submitted on 4th October 2020 and 20th November 2020.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Aubert Bonn, N., Pinxten, W.. 2020-06-23. Advancing science or advancing careers? Researchers' opinions on success indicators. https://doi.org/10.1101/2020.06.22.165654

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education

Cooperative efforts on developing vaccines and therapies for COVID-19

Health organizations have always sought partnership to join competencies in innovation, even with fierce competition in this sector. In this pandemic moment it is relevant to observe how organizations behave to seek quick and safe answers. The present research analyzes how the cooperation networks were set off considering the clinical trials on therapies and vaccines that were developed specifically to treat or prevent COVID-19. Social Network Analysis technique was used to build cooperation networks and apply metrics that characterize these connections. There was an evaluation of statistics of Strength of cooperation and Unilateral dependence of cooperation that identify the cooperation strength between two organizations, and the dependence of this relations. A total of 415 clinical trial were identified, of which 42% are in cooperation. From organizations that have partnership, firms are the first, followed by universities. We extracted the main categories that concentrate 74% of partnerships in the trials of antibody, and vaccine. Several organizations cooperate in multiple categories of trials, evidencing the efforts to focus on different strategies to treat the disease. We found high strength of cooperation and an assimetryc dependency between partners, which can be assigned to specialized models of partnership and it occurs in competitive enviroments like this pandemic moment. Cooperation were not limited to geographical proximity and the advent of Chinese players can represent a new change in the biotechnological development axis. Finally, the challenge of finding therapeutic or immunological solutions for COVID-19 demonstrates a clear composition of cooperation groups that complement their skills to manage organizational strategies to beat the pandemic. In this new paradigm, there can be partnerships not only in clinical trial but also in pre-competitive technologies development. This experience is expected to change the way of organizations define their R&D strategies and start to adopt more a collaborative innovation model.

scientific communication and education

A Mental Health Paradox: Mental health was both a motivator and barrier to physical activity during the COVID-19 pandemic

The COVID-19 pandemic has impacted the mental health, physical activity, and sedentary behavior of citizens worldwide. Using an online survey with 1669 respondents, we sought to understand why and how by querying about perceived barriers and motivators to physical activity that changed because of the pandemic, and how those changes impacted mental health. Consistent with prior reports, our respondents were less physically active (aerobic activity, -11%, p <0.05; strength-based activity, -30%, p<0.01) and more sedentary (+11%, p<0.01) during the pandemic as compared to 6-months before. The pandemic also increased psychological stress (+22%, p <0.01) and brought on moderate symptoms of anxiety and depression. Respondents whose mental health deteriorated the most were also the ones who were least active (depression r = -.21, p<0.01; anxiety r = -.12, p<0.01). The majority of respondents were unmotivated to exercise because they were too anxious (+8%, p <0.01), lacked social support (+6%, p =<0.01), or had limited access to equipment (+23%, p <0.01) or space (+41%, p <0.01). The respondents who were able to stay active reported feeling less motivated by physical health outcomes such as weight loss (-7%, p<0.01) or strength (-14%, p<0.01) and instead more motivated by mental health outcomes such as anxiety relief (+14%, p <0.01). Coupled with previous work demonstrating a direct relationship between mental health and physical activity, these results highlight the potential protective effect of physical activity on mental health and point to the need for psychological support to overcome perceived barriers so that people can continue to be physically active during stressful times like the pandemic.

scientific communication and education