Search bioRxiv⌕ Search

bioRxiv · 10.1101/2021.03.15.435418

scite: a smart citation index that displays the context of citations and classifies their intent using deep learning

Abstract

Citation indices are tools used by the academic community for research and research evaluation which aggregate scientific literature output and measure scientific impact by collating citation counts. Citation indices help measure the interconnections between scientific papers but fall short because they only display paper titles, authors, and the date of publications, and fail to communicate contextual information about why a citation was made. The usage of citations in research evaluation without due consideration to context can be problematic, if only because a citation that disputes a paper is treated the same as a citation that supports it. To solve this problem, we have used machine learning and other techniques to develop a "smart citation index" called scite, which categorizes citations based on context. Scite shows how a citation was used by displaying the surrounding textual context from the citing paper, and a classification from our deep learning model that indicates whether the statement provides supporting or disputing evidence for a referenced work, or simply mentions it. Scite has been developed by analyzing over 23 million full-text scientific articles and currently has a database of more than 800 million classified citation statements. Here we describe how scite works and how it can be used to further research and research evaluation.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Nicholson, J. M., Mordaunt, M., Lopez, P., Uppala, A., Rosati, D., Rodrigues, N. P., Grabitz, P., Rife, S.. 2021-03-16. scite: a smart citation index that displays the context of citations and classifies their intent using deep learning. https://doi.org/10.1101/2021.03.15.435418

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

Welfare concerns for mounted load carrying by working donkeys in Pakistan

Working donkeys (Equus asinus) are vital to peoples livelihoods. They are essential for carrying goods, however globally, overloading is one of the primary welfare concerns of working donkeys. We studied mounted load carrying by donkeys and associated factors in Pakistan. A cross-sectional study of donkey owners (n = 332) was conducted, and interviews were undertaken based on a questionnaire. Owners estimated that the median weight of their donkeys was 110kg (interquartile range (IQR) 100-120kg), and that they carried a median mounted load of 81.5kg (IQR 63-99kg). We found that 87.4% of donkeys carried a load above 50% of their bodyweight ratio (BWR), the median BWR carried was 77.1% (IQR 54.5-90.7%), and 25.3% of donkeys carried above 90% BWR. Donkeys that were loaded at more than 50% BWR were more likely to sit, compared to donkeys loaded with less weight (p=0.01). Donkeys working in peri-urban and urban areas were more likely to carry a greater BWR than donkeys working in rural areas (P<0.001), as were those carrying construction materials or bricks, compared to agricultural materials (p=0.004). Age (p=0.03) and breed (p=0.01) were also associated with carrying a higher weight. Overloading based on current recommendations (50% BWR) was common, with the majority (87.4%) of donkeys reported to carry more than the recommended 50% limit. This survey provides evidence of on-the-ground working practices and factors associated with mounted load carrying, which is critical for developing evidence-based recommendations for loading, in order to improve the welfare of working donkeys.

scientific communication and education↗