Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.64898/2026.05.28.728616

SortIT - A Tool For Assessing Observer Variability And Creating Ground Truth Image Classification Datasets

Uegami, W.·Bisson, T.·Okoshi, E. N.·Costa da Silva, F. G.·Jiragawasan, C.·Zerbe, N.·Bychkov, A.·Fukuoka, J.
View original source ↗Export metadata ↓

Abstract

Interobserver variability in pathological assessments is a well-recognized challenge that impacts diagnostic reliability and disease understanding. This variability exists across many subspecialties due to the subjective nature of evaluations. Artificial intelligence (AI) applied to whole slide images has potential to standardize procedures and reduce variability in pathology, but transitioning to these technologies does not guarantee improvement. Establishing reliable ground truth datasets with consensus annotations is crucial for developing robust AI solutions. We introduce SortIT, an open-source web application that facilitates systematic creation and evaluation of ground truth image tile annotations. SortIT enables multiple annotators to independently label tiles, with flexible user permission controls. Annotated data can be exported for statistical analysis of observer variation and for creating ground truth datasets from consensus tiles. We outline protocols using SortIT for several use cases: (1) mitosis segmentation in tumor regions, (2) evaluating AI solutions for prostate cancer grading by comparing to expert consensus, and (3) granuloma classification by annotating discriminative tile-level features. Key strengths of SortIT lies in its ease of deployment, making it accessible and usable for a wide range of users. Overall, SortIT provides a valuable tool to establish high-quality ground truth datasets and comprehensively assess observer variability. Critical evaluation of ground truth quality using systematic annotation methodologies is crucial for developing accurate and generalizable diagnostic AI tools. Its open-source nature facilitates community adoption and further development.

Explore related subjects

pathologyPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Uegami, W., Bisson, T., Okoshi, E. N., Costa da Silva, F. G., Jiragawasan, C., Zerbe, N., Bychkov, A., Fukuoka, J.. 2026-05-29. SortIT - A Tool For Assessing Observer Variability And Creating Ground Truth Image Classification Datasets. https://doi.org/10.64898/2026.05.28.728616

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Prevention of Unc13a cryptic splicing is sufficient to preserve memory

TDP-43 dysfunction is thought to underlie frontotemporal dementia and limbic-predominant age-related TDP-43 encephalopathy, neurodegenerative dementias currently without effective therapy. Therapeutic strategies are designed to correct individual cryptic targets of TDP-43, such as UNC13A, whereby its cryptic splicing compromises synaptic function, yet the sufficiency of such an approach to prevent memory deficits is unclear. Using a forebrain neuron-specific TDP-43 knockout mouse model that recapitulates TDP-43 dysfunction occurring during early stages of human disorders, we found here that prevention of cryptic splicing to include that of Unc13a attenuated memory deficits. We show that genetic ablation of Unc13a cryptic exon solely in such TDP-43 knockout mice is sufficient to preserve cognition, supporting the clinical value of targeting UNC13A to mitigate memory deficits. Prevention of cryptic splicing of multiple targets of TDP-43 additionally attenuate neuron loss. For optimal outcomes in TDP-43 related dementias, these findings thus strongly support strategies designed to repress cryptic splicing of multiple targets of TDP-43, including UNC13A.

pathology↗
bioRxiv2026

Social-Cognitive Dysregulation Model of Misophonia: Perspective from a Behavioural Study

Misophonia is increasingly conceptualized as more than a disorder of sound tolerance, with trigger over-reactivity shaped by the social meaning of sounds, inferred intentions, and representations of others actions. We tested a social-cognitive dysregulation model of misophonia in (N = 341) adults using behavioural measures of Theory of Mind and emotion recognition, alongside measures of reflective functioning, empathy, alexithymia, and mimicry. Dimensional associations with misophonia severity and its five different dimensions were examined while accounting for age, sex, sound sensitivity, and anxiety/depressive symptoms. Increased misophonia severity was associated with less accurate and slower mental-state inference and emotion recognition. ToM accuracy effects were evident for more complex, cognitive, and affective mentalizing, but not for simpler mentalizing or physical control judgments, while emotion-recognition accuracy differences emerged for positive but not negative stimuli. Greater severity was also characterized by reduced certainty and greater uncertainty about mental states, greater difficulty identifying one s own feelings, and elevated alexithymia, whereas global self-reported empathy was largely preserved. Misophonia severity further predicted a greater propensity to mimic trigger-producing actions or sounds; 41% of participants exceeding the S-Five clinical cutoff (> 87) endorsed mimicry, which was particularly associated with a subjective restoration of control. Findings remained robust following influential-case sensitivity analyses. These results reveal a selective disturbance in self-other representation spanning mentalizing, emotion decoding, emotional self-representation, and embodied regulatory processes. They position misophonia within a broader social-cognitive framework in which auditory-affective reactivity may intersect with altered inferential and sensorimotor processing, while stopping short of causal inference.

pathology↗
bioRxiv2026

Lamin A/C depletion from myofibers and satellite cells in mice reveals selective muscle pathology

Mutations in the laminA/C gene (LMNA), which encodes the nuclear lamina proteins lamin A and lamin C (lamin A/C), have been linked to different human diseases affecting different tissues. Most LMNA mutations cause cardiomyopathy and muscular dystrophy, such as autosomal dominant Emery-Dreifuss muscular dystrophy. Recent studies to understand striated muscle laminopathies have taken advantage of Lmna conditional knockout mice to examine the effects of lamin A/C depletion in cardiomyocytes and cardiac fibroblasts. However, the role of lamin A/C in skeletal muscle has largely been uncharacterized using conditional knockout mice. We used different mouse lines to deplete lamin A/C from specific cell types in striated muscle. Lamin A/C depletion from fetal myofibers and cardiomyocytes led to no observable phenotype in the skeletal muscles despite leading to dramatic heart dilation and early lethality. Depletion of lamin A/C from both skeletal myofibers and satellite cells was lethal, with the most dramatic myopathic abnormalities observed in the intrinsic muscles of the tongue. The presence of lamin A/C in skeletal muscle satellite cells prevented the development of lethal myopathy when the proteins were deleted only from differentiated myofibers. Overall, our results provide a foundation for understanding the roles of lamin A/C in muscle maintenance and development, including the variable skeletal muscle involvement and much more invariant cardiomyopathy in patients with LMNA mutations.

pathology↗