Deep-learning triage of 3D pathology datasets for comprehensive and efficient pathologist assessments

Abstract

Standard-of-care slide-based 2D histopathology severely undersamples spatially heterogeneous tissue specimens, with each thin 2D section representing <1% of the entire tissue volume (in the case of a biopsy). Recent advances in non-destructive 3D pathology, such as open-top light-sheet microscopy (OTLS), enable comprehensive high-resolution imaging of large clinical specimens. While fully automated computational analyses of such 3D pathology datasets are being explored, a potential low-risk route for accelerated clinical adoption would be to continue to rely upon pathologists to provide final diagnoses. Since manual review of these massive and complex 3D datasets is infeasible for routine clinical practice, we present CARP3D, a deep learning triage framework that identifies high-risk 2D cross sections within large 3D pathology datasets to enable time-efficient pathologist evaluation. CARP3D assigns risk scores to all 2D levels within a tissue volume by leveraging context from a subset of neighboring depth levels, outperforming models in which predictions are based on isolated 2D levels. In two use cases - risk stratification based on prostate cancer biopsies and screening for dysplasia/cancer in endoscopic biopsies of Barretts esophagus - AI-triaged 3D pathology, enabled by CARP3D, demonstrates the potential to improve the detection of high-risk diseases in comparison to slide-based 2D histopathology while optimizing pathologist workloads.