Search bioRxiv⌕ Search

bioRxiv · 10.1101/2021.07.23.453492

Delineating Medical Education: Bibliometric Research Approach(es)

Abstract

BackgroundThe field of medical education remains poorly delineated such that there is no broad consensus of the articles and journals that comprise "the field." This lack of consensus has implications for conducting bibliometric studies and other research designs (e.g., systematic reviews); it also challenges the field to compare citation scores in the field and across others and for an individual to identify themselves as "a medical education researcher." Other fields have utilized bibliometric field delineation, which is the assigning of articles or journals to a certain field in an effort to define that field. ProcessIn this Research Approach, three bibliometric field delineation approaches -- information retrieval, core journals, and journal co-citation -- are introduced. For each approach, the authors describe their attempt to apply it in the medical education context and identify related strengths and weaknesses. Based on co-citation, the authors propose the Medical Education Journal List 24 (MEJ-24), as a starting point for delineating medical education and invite the community to collaborate on improving and potentially expanding this list. PearlsAs a research approach, field delineation is complicated, and there is no clear best way to delineate the field of medical education. However, recent advances in information and computer science provide potentially more fruitful approaches to deal with the complexity of the field. When considering these emerging approaches, researchers should consider collaborating with bibliometricians. Bibliometric approaches rely on available metadata for articles and journals, which necessitates that researchers examine the metadata prior to analysis to understand its strengths and weaknesses, and to assess how this might affect their data interpretation. While using bibliometric approaches for field delineation is valuable, it is important to remember that these techniques are only as good as the research teams interpretation of the data, which suggests that an expanded research approach is needed to better delineate medical education, an approach that includes active discussion within the medical education community.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Maggio, L. A., Ninkov, A., Frank, J. R., Costello, J. A., Artino, A. R.. 2021-07-26. Delineating Medical Education: Bibliometric Research Approach(es). https://doi.org/10.1101/2021.07.23.453492

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

Welfare concerns for mounted load carrying by working donkeys in Pakistan

Working donkeys (Equus asinus) are vital to peoples livelihoods. They are essential for carrying goods, however globally, overloading is one of the primary welfare concerns of working donkeys. We studied mounted load carrying by donkeys and associated factors in Pakistan. A cross-sectional study of donkey owners (n = 332) was conducted, and interviews were undertaken based on a questionnaire. Owners estimated that the median weight of their donkeys was 110kg (interquartile range (IQR) 100-120kg), and that they carried a median mounted load of 81.5kg (IQR 63-99kg). We found that 87.4% of donkeys carried a load above 50% of their bodyweight ratio (BWR), the median BWR carried was 77.1% (IQR 54.5-90.7%), and 25.3% of donkeys carried above 90% BWR. Donkeys that were loaded at more than 50% BWR were more likely to sit, compared to donkeys loaded with less weight (p=0.01). Donkeys working in peri-urban and urban areas were more likely to carry a greater BWR than donkeys working in rural areas (P<0.001), as were those carrying construction materials or bricks, compared to agricultural materials (p=0.004). Age (p=0.03) and breed (p=0.01) were also associated with carrying a higher weight. Overloading based on current recommendations (50% BWR) was common, with the majority (87.4%) of donkeys reported to carry more than the recommended 50% limit. This survey provides evidence of on-the-ground working practices and factors associated with mounted load carrying, which is critical for developing evidence-based recommendations for loading, in order to improve the welfare of working donkeys.

scientific communication and education↗