Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/2020.03.09.983429

Assessing the impact of introductory programming workshops on the computational reproducibility of biomedical workflows

Deardorff, A.
View original source ↗Export metadata ↓

Abstract

IntroductionAs biomedical research becomes more data-intensive, computational reproducibility is a growing area of importance. Unfortunately, many biomedical researchers have not received formal computational training and often struggle to produce results that can be reproduced using the same data, code, and methods. Programming workshops can be a tool to teach new computational methods, but it is not always clear whether researchers are able to use their new skills to make their work more computationally reproducible. MethodsThis mixed methods study consisted of in-depth interviews with 14 biomedical researchers before and after participation in an introductory programming workshop. During the interviews, participants described their research workflows and responded to a quantitative checklist measuring reproducible behaviors. The interview data was analyzed using a thematic analysis approach, and the pre and post workshop checklist scores were compared to assess the impact of the workshop on computational reproducibility of the researchers workflows. ResultsPre and post scores on a checklist of reproducible behaviors did not increase in a statistically significant manner. The qualitative interviews revealed that several participants had made small changes to their workflows including switching to open source programming languages for their data cleaning, analysis, and visualization. Overall many of the participants indicated higher levels of programming literacy and an interest in further training. Factors that enabled change included supportive environments and an immediate research need, while barriers included collaborators that were resistant to new tools and a lack of time. ConclusionWhile none of the participants completely changed their workflows, many of them did incorporate new practices, tools, or methods that helped make their work more reproducible and transparent to other researchers. This indicate that programming workshops now offered by libraries and other organizations contribute to computational reproducibility training for researchers

Source connections

Explore related subjects

scientific communication and educationPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Deardorff, A.. 2020-03-09. Assessing the impact of introductory programming workshops on the computational reproducibility of biomedical workflows. https://doi.org/10.1101/2020.03.09.983429

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗
bioRxiv2020

Access to Scientific Literature by the Conservation Community

Access to the scientific literature is perceived to be a challenge to the biodiversity conservation community, but actual level of literature access relative to needs has never been assessed globally. We examined this question by surveying the constituency of the International Union for Conservation of Nature (IUCN) as a proxy for the conservation community, generating 2,285 responses. Of these respondents, ∼97% need to use the scientific literature in order to support their IUCN-related conservation work, with ∼50% needing to do so at least once per week. The crux of the survey revolved around the question, “How easy is it for you currently to obtain the scientific literature you need to carry out your IUCN-related work?” and revealed that roughly half (49%) of the respondents find it not easy or not at all easy to access scientific literature. We fitted a binary logistic regression model to explore factors predicting ease of literature access. Whether the respondent had institutional literature access (55% do) is the strongest predictor, with region (Western Europe, the United States, Canada, Australia and New Zealand) and gender (male) also significant predictors. Approximately 60% of respondents from Western Europe, the United States, Canada, Australia and New Zealand have institutional access compared to ∼50% in Asia and Latin America, and ∼40% in Eastern Europe and in Africa. Nevertheless, accessing free online material is a popular means of accessing literature for both those with and without institutional access. The four journals most frequently mentioned when asked which journal access would deliver the greatest improvements to the respondent’s IUCN-related work were Conservation Biology, Biological Conservation, Nature, and Science. The majority prefer to read journal articles on screen but prefer to read books in hard copy. Overall, it is apparent that access to the literature is a challenge facing roughly half of the conservation community worldwide.View Full Text

scientific communication and education↗
bioRxiv2020

Interpretative guides for interacting with tissue atlas and digital pathology data using the Minerva browser

The recent development of highly multiplexed tissue imaging promises to substantially accelerate research into basic biology and human disease. Concurrently, histopathology in a clinical setting is undergoing a rapid transition to digital methods. Online tissue atlases involving highly multiplexed images of research and clinical specimens will soon join genomics as a systematic source of information on the molecular basis of disease and therapeutic response. However, even with recent advances in machine learning, experience with anatomic pathology shows that there is no immediate substitute for expert visual review, annotation, and description of tissue images. In this perspective we review the ecosystem of software available for analysis of tissue images and identify a need for interactive guides or "digital docents" that allow experts to help make complex images intelligible. We illustrate this idea using Minerva software and discuss how interactive image guides are being integrated into multi-omic browsers for effective dissemination of atlas data.

scientific communication and education↗