Search bioRxiv⌕ Search

Biology subjects

Uegami, W.

Publications and source records attributed to Uegami, W..

2 recordsLinked to original sources

SortIT - A Tool For Assessing Observer Variability And Creating Ground Truth Image Classification Datasets

Interobserver variability in pathological assessments is a well-recognized challenge that impacts diagnostic reliability and disease understanding. This variability exists across many subspecialties due to the subjective nature of evaluations. Artificial intelligence (AI) applied to whole slide images has potential to standardize procedures and reduce variability in pathology, but transitioning to these technologies does not guarantee improvement. Establishing reliable ground truth datasets with consensus annotations is crucial for developing robust AI solutions. We introduce SortIT, an open-source web application that facilitates systematic creation and evaluation of ground truth image tile annotations. SortIT enables multiple annotators to independently label tiles, with flexible user permission controls. Annotated data can be exported for statistical analysis of observer variation and for creating ground truth datasets from consensus tiles. We outline protocols using SortIT for several use cases: (1) mitosis segmentation in tumor regions, (2) evaluating AI solutions for prostate cancer grading by comparing to expert consensus, and (3) granuloma classification by annotating discriminative tile-level features. Key strengths of SortIT lies in its ease of deployment, making it accessible and usable for a wide range of users. Overall, SortIT provides a valuable tool to establish high-quality ground truth datasets and comprehensively assess observer variability. Critical evaluation of ground truth quality using systematic annotation methodologies is crucial for developing accurate and generalizable diagnostic AI tools. Its open-source nature facilitates community adoption and further development.

pathology↗

Deep learning for histopathological subtyping and grading of lung adenocarcinoma

The histopathological distinction of lung adenocarcinoma (LADC) subtypes is subject to high inter-observer variability, which can compromise the optimal assessment of the patient prognosis. Therefore, this study developed convolutional neural networks (CNNs) capable of distinguishing LADC subtypes and predicting disease-specific survival, according to the LADC tumour grades established recently by the International Association for the Study of Lung Cancer pathology committee. Consensus LADC ground truth histopathological images were obtained from seventeen expert pulmonary pathologists and one pathologist in training. Two deep learning models (AI-1 and AI-2) were trained with EfficientNet b3 architecture to predict eight different LADC classes (lepidic, acinar, papillary, micropapillary, solid, invasive mucinous adenocarcinoma, other carcinoma types, and no carcinoma cells). Furthermore, the trained models were tested on an independent cohort of 133 patients. The models achieved high precision, recall, and F1-scores exceeding 0.90 for most of the LADC classes. Clear stratification of the three LADC grades was reached in predicting the disease-specific survival by the two models. Moreover, the grading prediction of one of the trained models was more accurate than those of 14 out of 15 pulmonary pathologists involved in the study (p=0.0003). Both trained models showed high stability in the segmentation of each pair of predicted grades with low variation in the hazard ratio across 200 bootstrapped samples. These findings indicate that the trained CNNs improve the diagnostic accuracy of the pathologist, standardise LADC subtype recognition, and refine LADC grade assessment. Thus, the trained models are promising tools that may assist in the routine evaluation of LADC subtypes and grades in clinical practice.

pathology↗