Search bioRxiv⌕ Search

bioRxiv · 10.1101/2020.09.23.310052

Co-Citation Percentile Rank and JYUcite: a new network-standardized output-level citation influence metric and its implementation using Dimensions API

Abstract

Judging value of scholarly outputs quantitatively remains a difficult but unavoidable challenge. Most of the proposed solutions suffer from three fundamental shortcomings: they involve i) the concept of journal, in one way or another, ii) calculating arithmetic averages from extremely skewed distributions, and iii) binning data by calendar year. Here, we introduce a new metric Co-citation Percentile Rank (CPR), that relates the current citation rate of the target output taken at resolution of days since first citable, to the distribution of current citation rates of outputs in its co-citation set, as its percentile rank in that set. We explore some of its properties with an example dataset of all scholarly outputs from University of Jyvaskyla spanning multiple years and disciplines. We also demonstrate how CPR can be efficiently implemented with Dimensions database API, and provide a publicly available web resource JYUcite, allowing anyone to retrieve CPR value for any output that has a DOI and is indexed in the Dimensions database. Finally, we discuss how CPR remedies failures of the Relative Citation Ratio (RCR), and remaining issues in situations where CPR too could potentially lead to biased judgement of value.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Seppanen, J.-T., Varri, H., Ylonen, I.. 2020-09-23. Co-Citation Percentile Rank and JYUcite: a new network-standardized output-level citation influence metric and its implementation using Dimensions API. https://doi.org/10.1101/2020.09.23.310052

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

Welfare concerns for mounted load carrying by working donkeys in Pakistan

Working donkeys (Equus asinus) are vital to peoples livelihoods. They are essential for carrying goods, however globally, overloading is one of the primary welfare concerns of working donkeys. We studied mounted load carrying by donkeys and associated factors in Pakistan. A cross-sectional study of donkey owners (n = 332) was conducted, and interviews were undertaken based on a questionnaire. Owners estimated that the median weight of their donkeys was 110kg (interquartile range (IQR) 100-120kg), and that they carried a median mounted load of 81.5kg (IQR 63-99kg). We found that 87.4% of donkeys carried a load above 50% of their bodyweight ratio (BWR), the median BWR carried was 77.1% (IQR 54.5-90.7%), and 25.3% of donkeys carried above 90% BWR. Donkeys that were loaded at more than 50% BWR were more likely to sit, compared to donkeys loaded with less weight (p=0.01). Donkeys working in peri-urban and urban areas were more likely to carry a greater BWR than donkeys working in rural areas (P<0.001), as were those carrying construction materials or bricks, compared to agricultural materials (p=0.004). Age (p=0.03) and breed (p=0.01) were also associated with carrying a higher weight. Overloading based on current recommendations (50% BWR) was common, with the majority (87.4%) of donkeys reported to carry more than the recommended 50% limit. This survey provides evidence of on-the-ground working practices and factors associated with mounted load carrying, which is critical for developing evidence-based recommendations for loading, in order to improve the welfare of working donkeys.

scientific communication and education↗