Search bioRxiv⌕ Search

Biology subjects

Kochanny, S.

Publications and source records attributed to Kochanny, S..

7 recordsLinked to original sources

FEATMAP: Targeted Correction of Acquisition Signatures Harmonizes Medical Foundation Model Embeddings and Enables Robust Task Generalization

AO_SCPLOWBSTRACTC_SCPLOWMedical foundation models compress biomedical data into embeddings that support diverse downstream clinical tasks. However, successful model deployment is hampered by performance degradation on external data. It is recognized that embeddings capture acquisition signatures, such as hardware and technical differences, in addition to biology. Effective harmonization must remove the acquisition signature while preserving biological signals, a trade-off that current methods fail to balance adequately. Input-level normalization fails to eliminate acquisition signatures from embeddings, whereas embedding-level methods adjust features in an untargeted manner. We present FEATMAP, a harmonization approach that models acquisition signatures as geometric distortions between manifolds of similarly arranged embeddings. Using paired data that isolate the effect of acquisition signatures, FEATMAP fits a single global affine transformation per foundation model to correct acquisition signatures directly in the embedding space. This targeted, reusable correction aims to preserve biological and demographic variation while harmonizing across acquisition signatures. Across scanner and foundation-model harmonization in digital pathology and field-strength harmonization in brain MRI, FEATMAP improves cross-condition embedding similarity, reduces performance gaps without retraining, and suggests potential for the alignment of disparate embedding spaces.

bioinformatics↗

Generative Adversarial Networks Accurately Reconstruct Pan-Cancer Histology from Pathologic, Genomic, and Radiographic Latent Features

Artificial intelligence models have been increasingly used in the analysis of tumor histology to perform tasks ranging from routine classification to identification of novel molecular features. These approaches distill cancer histologic images into high-level features which are used in predictions, but understanding the biologic meaning of such features remains challenging. We present and validate a custom generative adversarial network - HistoXGAN - capable of reconstructing representative histology using feature vectors produced by common feature extractors. We evaluate HistoXGAN across 29 cancer subtypes and demonstrate that reconstructed images retain information regarding tumor grade, histologic subtype, and gene expression patterns. We leverage HistoXGAN to illustrate the underlying histologic features for deep learning models for actionable mutations, identify model reliance on histologic batch effect in predictions, and demonstrate accurate reconstruction of tumor histology from radiographic imaging for a virtual biopsy.

cancer biology↗

Validating a low-cost, open-source, locally manufactured workstation and computational pipeline for automated histopathology evaluation using deep learning

Deployment and access to state-of-the-art diagnostic technologies remains a fundamental challenge in providing equitable global cancer care to low-resource settings. The expansion of digital pathology in recent years and its interface with computational biomarkers provides an opportunity to democratize access to personalized medicine. Here we describe a low-cost platform for digital side capture and computational analysis composed of open-source components. The platform provides low-cost ($200) digital image capture from glass slides and is capable of real-time computational image analysis using an open-source deep learning (DL) algorithm and Raspberry Pi ($35) computer. We validate the performance of deep learning models performance using images captured from the open-source workstation and show similar model performance when compared against significantly more expensive standard institutional hardware.

pathology↗

Latent transcriptional programs reveal histology-encoded tumor features spanning tissue origins

Precision medicine in cancer treatment depends on deciphering tumor phenotypes to reveal the underlying biological processes. Molecular profiles, including transcriptomics, provide an information-rich tumor view, but their high-dimensional features and assay costs can be prohibitive for clinical translation at scale. Recent studies have suggested jointly leveraging histology and genomics as a strategy for developing practical clinical biomarkers. Here, we use machine learning techniques to identify de novo latent transcriptional processes in squamous cell carcinomas (SCCs) and to accurately predict their activity levels directly from tumor histology images. In contrast to analyses focusing on pre-specified, individual genes or sample groups, our latent space analysis reveals sets of genes associated with both histologically detectable features and clinically relevant processes, including immune response, collagen remodeling, and fibrosis. The results demonstrate an approach for discovering clinically interpretable histological features that indicate complex, potentially treatment-informing biological processes.

cancer biology↗

Multimodal Prediction of Breast Cancer Recurrence Assays and Risk of Recurrence

Gene expression-based recurrence assays are strongly recommended to guide the use of chemotherapy in hormone receptor-positive, HER2-negative breast cancer, but such testing is expensive, can contribute to delays in care, and may not be available in low-resource settings. Here, we describe the training and independent validation of a deep learning model that predicts recurrence assay result and risk of recurrence using both digital histology and clinical risk factors. We demonstrate that this approach outperforms an established clinical nomogram (area under the receiver operating characteristic curve of 0.833 versus 0.765 in an external validation cohort, p = 0.003), and can identify a subset of patients with excellent prognoses who may not need further genomic testing.

cancer biology↗

The Impact of Digital Histopathology Batch Effect on Deep Learning Model Accuracy and Bias

The Cancer Genome Atlas (TCGA) is one of the largest biorepositories of digital histology. Deep learning (DL) models have been trained on TCGA to predict numerous features directly from histology, including survival, gene expression patterns, and driver mutations. However, we demonstrate that these features vary substantially across tissue submitting sites in TCGA for over 3,000 patients with six cancer subtypes. Additionally, we show that histologic image differences between submitting sites can easily be identified with DL. This site detection remains possible despite commonly used color normalization and augmentation methods, and we quantify the digital image characteristics constituting this histologic batch effect. As an example, we show that patient ethnicity within the TCGA breast cancer cohort can be inferred from histology due to site-level batch effect, which must be accounted for to ensure equitable application of DL. Batch effect also leads to overoptimistic estimates of model performance, and we propose a quadratic programming method to guide validation that abrogates this bias.

bioinformatics↗

Deep learning detects virus presence in cancer histology

Oncogenic viruses like human papilloma virus (HPV) or Epstein Barr virus (EBV) are a major cause of human cancer. Viral oncogenesis has a direct impact on treatment decisions because virus-associated tumors can demand a lower intensity of chemotherapy and radiation or can be more susceptible to immune check-point inhibition. However, molecular tests for HPV and EBV are not ubiquitously available.\n\nWe hypothesized that the histopathological features of virus-driven and non-virus driven cancers are sufficiently different to be detectable by artificial intelligence (AI) through deep learning-based analysis of images from routine hematoxylin and eosin (HE) stained slides. We show that deep transfer learning can predict presence of HPV in head and neck cancer with a patient-level 3-fold cross validated area-under-the-curve (AUC) of 0.89 [0.82; 0.94]. The same workflow was used for Epstein-Barr virus (EBV) driven gastric cancer achieving a cross-validated AUC of 0.80 [0.70; 0.92] and a similar performance in external validation sets. Reverse-engineering our deep neural networks, we show that the key morphological features can be made understandable to humans.\n\nThis workflow could enable a fast and low-cost method to identify virus-induced cancer in clinical trials or clinical routine. At the same time, our approach for feature visualization allows pathologists to look into the black box of deep learning, enabling them to check the plausibility of computer-based image classification.

cancer biology↗