Search bioRxiv⌕ Search

Biology subjects

Foroughi pour, A.

Publications and source records attributed to Foroughi pour, A..

3 recordsLinked to original sources

SAMPLER: Empirical distribution representations for rapid analysis of whole slide tissue images

Deep learning has revolutionized digital pathology, allowing for automatic analysis of hematoxylin and eosin (H&E) stained whole slide images (WSIs) for diverse tasks. In such analyses, WSIs are typically broken into smaller images called tiles, and a neural network backbone encodes each tile in a feature space. Many recent works have applied attention based deep learning models to aggregate tile-level features into a slide-level representation, which is then used for slide-level prediction tasks. However, training attention models is computationally intensive, necessitating hyperparameter optimization and specialized training procedures. Here, we propose SAMPLER, a fully statistical approach to generate efficient and informative WSI representations by encoding the empirical cumulative distribution functions (CDFs) of multiscale tile features. We demonstrate that SAMPLER-based classifiers are as accurate or better than state-of-the-art fully deep learning attention models for classification tasks including distinction of: subtypes of breast carcinoma (BRCA: AUC=0.911 {+/-} 0.029); subtypes of non-small cell lung carcinoma (NSCLC: AUC=0.940{+/-}0.018); and subtypes of renal cell carcinoma (RCC: AUC=0.987{+/-}0.006). A major advantage of the SAMPLER representation is that predictive models are >100X faster compared to attention models. Histopathological review confirms that SAMPLER-identified high attention tiles contain tumor morphological features specific to the tumor type, while low attention tiles contain fibrous stroma, blood, or tissue folding artifacts. We further apply SAMPLER concepts to improve the design of attention-based neural networks, yielding a context aware multi-head attention model with increased accuracy for subtype classification within BRCA and RCC (BRCA: AUC=0.921{+/-}0.027, and RCC: AUC=0.988{+/-}0.010). Finally, we provide theoretical results identifying sufficient conditions for which SAMPLER is optimal. SAMPLER is a fast and effective approach for analyzing WSIs, with greatly improved scalability over attention methods to benefit digital pathology analysis.

bioinformatics↗

A pan-cancer PDX histology image repository with genomic and pathological annotations for deep learning analysis

Patient-derived xenografts (PDXs) model human intra-tumoral heterogeneity in the context of the intact tissue of immunocompromised mice. Histological imaging via hematoxylin and eosin (H&E) staining is performed on PDX samples for routine assessment and, in principle, captures the complex interplay between tumor and stromal cells. Deep learning (DL)-based analysis of large human H&E image repositories has extracted inter-cellular and morphological signals correlated with disease phenotype and therapeutic response. Here, we present an extensive, pan-cancer repository of nearly 1,000 PDX and paired human progenitor H&E images. These images, curated from the PDXNet consortium, are associated with genomic and transcriptomic data, clinical metadata, pathological assessment of cell composition, and, in several cases, detailed pathological annotation of tumor, stroma, and necrotic regions. We demonstrate that DL can be applied to these images to classify tumor regions and to predict xenograft-transplant lymphoproliferative disorder, the unintended outgrowth of human lymphocytes at the transplantation site. This repository enables PDX-specific, investigations of cancer biology through histopathological analysis and contributes important model system data that expand on existing human histology repositories. We expect the PDXNet Image Repository to be valuable for controlled digital pathology analysis, both for the evaluation of technical issues such as stain normalization and for development of novel computational methods based on spatial behaviors within cancer tissues.

bioinformatics↗

Integrative deep learning analysis improves colon adenocarcinoma patient stratification at risk for mortality

Colorectal cancers are the fourth most commonly diagnosed cancer and the second leading cancer in number of deaths. Many clinical variables, pathological features, and genomic signatures are associated with patient risk, but reliable patient stratification in the clinic remains a challenging task. Here we assess how image, clinical, and genomic features can be combined to predict risk. We first observe that deep learning models based only on whole slide images (WSIs) from The Cancer Genome Atlas accurately separate high risk (OS<3years, N=38) from low risk (OS>5years, N=25) patients (AUC=0.81{+/-}0.08, 5year survival p-value=2.13e-25, 5year relative risk=5.09{+/-}0.05) though such models are less effective at predicting OS for moderate risk (3years<OS<5years, N=45) patients (5year survival p-value=0.5, 5year relative risk=1.32{+/-}0.09). However, we find that novel integrative models combining whole slide images, clinical variables, and mutation signatures can improve patient stratification for moderate risk patients (5year survival p-value=6.69e-30, 5year relative risk=5.32{+/-}0.07). Our integrative model combining image and clinical variables is also effective on an independent pathology dataset generated by our team (3year survival p-value=1.14e-09, 5year survival p-value=2.15e-05, 3year relative risk=3.25{+/-}0.06, 5year relative-risk=3.07{+/-}0.08). The integrative model substantially outperforms models using only images or only clinical variables, indicating beneficial cross-talk between the data types. Pathologist review of image-based heatmaps suggests that nuclear shape, nuclear size pleomorphism, intense cellularity, and abnormal structures are associated with high risk, while low risk regions tend to have more regular and small cells. The improved stratification of colorectal cancer patients from our computational methods can be beneficial for preemptive development of management and treatment plans for individual patients, as well as for informed enrollment of patients in clinical trials.

pathology↗