Counterfactual Hypothesis Testing of Tumor Microenvironment Scenarios Through Semantic Image Synthesis

Abstract

AO_SCPLOWBSTRACTC_SCPLOWRecent multiplexed protein imaging technologies characterize cells, their spatial organization, and interactions within microenvironments at an unprecedented resolution. Although observational data can reveal spatial associations, it does not allow users to infer salient biological relationships and cellular interactions. To address this challenge, we develop a generative model that allows users to test hypotheses about the effect of cell-cell interactions on protein expression through in silico perturbation. Our Cell-Cell Interaction GAN (CCIGAN) model employs a generative adversarial network (GAN) architecture to generate high fidelity synthetic multiplexed images from semantic cell segmentations. Our approach is unique in that it learns relationships between all imaging channels simultaneously and yields biological insights from multiple imaging technologies in silico, capturing known tumor-immune cell interactions missed by other state-of-the-art GAN models.